2024-12-17T23:59:51.2307914Z Current runner version: '2.321.0'
2024-12-17T23:59:51.2317560Z Runner name: 'i-0988c0a7c81d79530'
2024-12-17T23:59:51.2319116Z Runner group name: 'Default'
2024-12-17T23:59:51.2320507Z Machine name: 'ip-10-1-51-133'
2024-12-17T23:59:51.2326923Z ##[group]GITHUB_TOKEN Permissions
2024-12-17T23:59:51.2330731Z Actions: read
2024-12-17T23:59:51.2331624Z Attestations: read
2024-12-17T23:59:51.2332535Z Checks: read
2024-12-17T23:59:51.2333454Z Contents: read
2024-12-17T23:59:51.2334325Z Deployments: read
2024-12-17T23:59:51.2335198Z Discussions: read
2024-12-17T23:59:51.2336111Z Issues: read
2024-12-17T23:59:51.2336973Z Metadata: read
2024-12-17T23:59:51.2337822Z Packages: read
2024-12-17T23:59:51.2338777Z Pages: read
2024-12-17T23:59:51.2339655Z PullRequests: read
2024-12-17T23:59:51.2340479Z RepositoryProjects: read
2024-12-17T23:59:51.2341548Z SecurityEvents: read
2024-12-17T23:59:51.2342466Z Statuses: read
2024-12-17T23:59:51.2343376Z ##[endgroup]
2024-12-17T23:59:51.2348096Z Secret source: Actions
2024-12-17T23:59:51.2349587Z Prepare workflow directory
2024-12-17T23:59:51.6924377Z Prepare all required actions
2024-12-17T23:59:51.6983565Z Getting action download info
2024-12-17T23:59:51.8961690Z Download action repository 'pytorch/test-infra@release/2.6' (SHA:eb0adf5a84668865394af69e26428b32c8105c1c)
2024-12-17T23:59:53.6504732Z Download action repository 'pytorch/pytorch@release/2.6' (SHA:0cdf8b1d09254cfda66191d1bd01e3041c3c76f7)
2024-12-18T00:00:07.4547641Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0)
2024-12-18T00:00:07.7467739Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a)
2024-12-18T00:00:08.3390823Z Getting action download info
2024-12-18T00:00:08.4781962Z Download action repository 'malfet/checkout@silent-checkout' (SHA:e07af140b3ccefc05679e3755b9db68f4ee4589c)
2024-12-18T00:00:08.7812118Z Getting action download info
2024-12-18T00:00:08.9104987Z Download action repository 'nick-fields/retry@v3.0.0' (SHA:7152eba30c6575329ac0576536151aca5a72780e)
2024-12-18T00:00:09.1049256Z Getting action download info
2024-12-18T00:00:09.2334341Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482)
2024-12-18T00:00:09.4564467Z Getting action download info
2024-12-18T00:00:09.5801874Z Download action repository 'pytorch/test-infra@main' (SHA:a07505a74641a4ff5123d635defac481ef28ef1e)
2024-12-18T00:00:11.3598412Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/heads/release/2.6 (0cdf8b1d09254cfda66191d1bd01e3041c3c76f7)
2024-12-18T00:00:11.3601337Z ##[group] Inputs
2024-12-18T00:00:11.3601905Z   build-environment: linux-focal-cuda11.8-py3.10-gcc9-debug
2024-12-18T00:00:11.3605095Z   test-matrix: {"include": [{"config": "default", "shard": 1, "num_shards": 5, "runner": "lf.linux.4xlarge.nvidia.gpu", "owners": ["oncall:debug-build"]}, {"config": "default", "shard": 2, "num_shards": 5, "runner": "lf.linux.4xlarge.nvidia.gpu", "owners": ["oncall:debug-build"]}, {"config": "default", "shard": 3, "num_shards": 5, "runner": "lf.linux.4xlarge.nvidia.gpu", "owners": ["oncall:debug-build"]}, {"config": "default", "shard": 4, "num_shards": 5, "runner": "lf.linux.4xlarge.nvidia.gpu", "owners": ["oncall:debug-build"]}, {"config": "default", "shard": 5, "num_shards": 5, "runner": "lf.linux.4xlarge.nvidia.gpu", "owners": ["oncall:debug-build"]}]}
2024-12-18T00:00:11.3608726Z   docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda11.8-cudnn9-py3-gcc9:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:00:11.3609795Z   sync-tag: 
2024-12-18T00:00:11.3611019Z   timeout-minutes: 240
2024-12-18T00:00:11.3611423Z   use-gha: 
2024-12-18T00:00:11.3611760Z   dashboard-tag: 
2024-12-18T00:00:11.3612100Z   s3-bucket: gha-artifacts
2024-12-18T00:00:11.3612493Z   aws-role-to-assume: 
2024-12-18T00:00:11.3613463Z   disable-monitor: false
2024-12-18T00:00:11.3614200Z ##[endgroup]
2024-12-18T00:00:11.3615203Z Complete job name: linux-focal-cuda11.8-py3.10-gcc9-debug / test (default, 4, 5, lf.linux.4xlarge.nvidia.gpu, oncall:debug-build)
2024-12-18T00:00:11.4303377Z A job started hook has been configured by the self-hosted runner administrator
2024-12-18T00:00:11.4514509Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh'
2024-12-18T00:00:11.4526888Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:00:11.4527981Z ##[endgroup]
2024-12-18T00:00:13.2733315Z Runner Type: lf.linux.4xlarge.nvidia.gpu
2024-12-18T00:00:13.2734005Z Instance Type: g3.4xlarge
2024-12-18T00:00:13.2734410Z AMI Name: unknown
2024-12-18T00:00:13.2766446Z AMI ID: ami-0fff1b9a61dec8a5f
2024-12-18T00:00:20.9816105Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@release/2.6
2024-12-18T00:00:20.9816775Z with:
2024-12-18T00:00:20.9817673Z   github-secret: ***
2024-12-18T00:00:20.9818606Z   instructions: All testing is done inside the container, to start an interactive session run:
  docker exec -it $(docker container ps --format '{{.ID}}') bash

2024-12-18T00:00:20.9819617Z   activate-with-label: false
2024-12-18T00:00:20.9820006Z   label: with-ssh
2024-12-18T00:00:20.9820359Z   remove-existing-keys: true
2024-12-18T00:00:20.9820727Z   fail-silently: true
2024-12-18T00:00:20.9821065Z env:
2024-12-18T00:00:20.9821447Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:00:20.9821819Z ##[endgroup]
2024-12-18T00:00:21.1413746Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info.
2024-12-18T00:00:21.1417072Z Not on pull request and ciflow reference could not be extracted, skipping adding ssh keys
2024-12-18T00:00:21.1576855Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@release/2.6
2024-12-18T00:00:21.1577554Z with:
2024-12-18T00:00:21.1577866Z   no-sudo: true
2024-12-18T00:00:21.1578217Z   submodules: recursive
2024-12-18T00:00:21.1578611Z   fetch-depth: 0
2024-12-18T00:00:21.1578958Z env:
2024-12-18T00:00:21.1579249Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:00:21.1579663Z ##[endgroup]
2024-12-18T00:00:21.1690595Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2024-12-18T00:00:21.1691822Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2024-12-18T00:00:21.1701479Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:00:21.1701994Z env:
2024-12-18T00:00:21.1702322Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:00:21.1702744Z ##[endgroup]
2024-12-18T00:00:21.1825340Z ##[group]Run retry () {
2024-12-18T00:00:21.1825764Z retry () {
2024-12-18T00:00:21.1826210Z   $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*)
2024-12-18T00:00:21.1826729Z }
2024-12-18T00:00:21.1827065Z echo "${GITHUB_WORKSPACE}"
2024-12-18T00:00:21.1827501Z if [ -z "${NO_SUDO}" ]; then
2024-12-18T00:00:21.1827987Z   retry sudo rm -rf "${GITHUB_WORKSPACE}"
2024-12-18T00:00:21.1828420Z else
2024-12-18T00:00:21.1828785Z   retry rm -rf "${GITHUB_WORKSPACE}"
2024-12-18T00:00:21.1829228Z fi
2024-12-18T00:00:21.1829563Z mkdir "${GITHUB_WORKSPACE}"
2024-12-18T00:00:21.1836447Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:00:21.1836959Z env:
2024-12-18T00:00:21.1837248Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:00:21.1837612Z   NO_SUDO: true
2024-12-18T00:00:21.1837929Z ##[endgroup]
2024-12-18T00:00:21.1867209Z /home/ec2-user/actions-runner/_work/pytorch/pytorch
2024-12-18T00:00:23.5720871Z ##[group]Run malfet/checkout@silent-checkout
2024-12-18T00:00:23.5721344Z with:
2024-12-18T00:00:23.5721766Z   ref: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:00:23.5722216Z   fetch-depth: 0
2024-12-18T00:00:23.5722549Z   submodules: recursive
2024-12-18T00:00:23.5722899Z   quiet-checkout: true
2024-12-18T00:00:23.5723259Z   repository: pytorch/pytorch
2024-12-18T00:00:23.5724079Z   token: ***
2024-12-18T00:00:23.5724374Z   ssh-strict: true
2024-12-18T00:00:23.5724714Z   persist-credentials: true
2024-12-18T00:00:23.5725086Z   clean: true
2024-12-18T00:00:23.5725420Z   sparse-checkout-cone-mode: true
2024-12-18T00:00:23.5725794Z   lfs: false
2024-12-18T00:00:23.5726112Z   set-safe-directory: true
2024-12-18T00:00:23.5726468Z env:
2024-12-18T00:00:23.5726761Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:00:23.5727109Z ##[endgroup]
2024-12-18T00:00:23.6902040Z Syncing repository: pytorch/pytorch
2024-12-18T00:00:23.6903919Z ##[group]Getting Git version info
2024-12-18T00:00:23.6904604Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch'
2024-12-18T00:00:23.6905498Z [command]/usr/bin/git version
2024-12-18T00:00:23.6905948Z git version 2.40.1
2024-12-18T00:00:23.6939399Z ##[endgroup]
2024-12-18T00:00:23.6962033Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/10e0ef1a-7135-4994-ae51-87815e236623' before making global git config changes
2024-12-18T00:00:23.6963269Z Adding repository directory to the temporary git global config as a safe directory
2024-12-18T00:00:23.6967633Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch
2024-12-18T00:00:23.7000492Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch'
2024-12-18T00:00:23.7005247Z ##[group]Initializing the repository
2024-12-18T00:00:23.7008819Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch
2024-12-18T00:00:23.7038330Z hint: Using 'master' as the name for the initial branch. This default branch name
2024-12-18T00:00:23.7039128Z hint: is subject to change. To configure the initial branch name to use in all
2024-12-18T00:00:23.7039831Z hint: of your new repositories, which will suppress this warning, call:
2024-12-18T00:00:23.7040367Z hint: 
2024-12-18T00:00:23.7040760Z hint: 	git config --global init.defaultBranch <name>
2024-12-18T00:00:23.7041239Z hint: 
2024-12-18T00:00:23.7041681Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2024-12-18T00:00:23.7042380Z hint: 'development'. The just-created branch can be renamed via this command:
2024-12-18T00:00:23.7042948Z hint: 
2024-12-18T00:00:23.7043263Z hint: 	git branch -m <name>
2024-12-18T00:00:23.7044000Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/
2024-12-18T00:00:23.7053847Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch
2024-12-18T00:00:23.7082971Z ##[endgroup]
2024-12-18T00:00:23.7083613Z ##[group]Disabling automatic garbage collection
2024-12-18T00:00:23.7087123Z [command]/usr/bin/git config --local gc.auto 0
2024-12-18T00:00:23.7116035Z ##[endgroup]
2024-12-18T00:00:23.7116600Z ##[group]Setting up auth
2024-12-18T00:00:23.7124166Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2024-12-18T00:00:23.7153295Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
2024-12-18T00:00:23.7487036Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2024-12-18T00:00:23.7516167Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
2024-12-18T00:00:23.7853198Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2024-12-18T00:00:23.7901083Z ##[endgroup]
2024-12-18T00:00:23.7901709Z ##[group]Fetching the repository
2024-12-18T00:00:23.7909804Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules --quiet origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/*
2024-12-18T00:00:26.5498857Z remote: Enumerating objects: 1056622        
2024-12-18T00:00:26.5499923Z remote: Enumerating objects: 1057261, done.        
2024-12-18T00:00:26.5500578Z remote: Counting objects:   0% (1/639)        
2024-12-18T00:00:26.5501063Z remote: Counting objects:   1% (7/639)        
2024-12-18T00:00:26.5501536Z remote: Counting objects:   2% (13/639)        
2024-12-18T00:00:26.5501996Z remote: Counting objects:   3% (20/639)        
2024-12-18T00:00:26.5502474Z remote: Counting objects:   4% (26/639)        
2024-12-18T00:00:26.5502956Z remote: Counting objects:   5% (32/639)        
2024-12-18T00:00:26.5503431Z remote: Counting objects:   6% (39/639)        
2024-12-18T00:00:26.5503927Z remote: Counting objects:   7% (45/639)        
2024-12-18T00:00:26.5504394Z remote: Counting objects:   8% (52/639)        
2024-12-18T00:00:26.5504884Z remote: Counting objects:   9% (58/639)        
2024-12-18T00:00:26.5505352Z remote: Counting objects:  10% (64/639)        
2024-12-18T00:00:26.5505830Z remote: Counting objects:  11% (71/639)        
2024-12-18T00:00:26.5506331Z remote: Counting objects:  12% (77/639)        
2024-12-18T00:00:26.5506808Z remote: Counting objects:  13% (84/639)        
2024-12-18T00:00:26.5507275Z remote: Counting objects:  14% (90/639)        
2024-12-18T00:00:26.5507750Z remote: Counting objects:  15% (96/639)        
2024-12-18T00:00:26.5508279Z remote: Counting objects:  16% (103/639)        
2024-12-18T00:00:26.5508765Z remote: Counting objects:  17% (109/639)        
2024-12-18T00:00:26.5509248Z remote: Counting objects:  18% (116/639)        
2024-12-18T00:00:26.5509740Z remote: Counting objects:  19% (122/639)        
2024-12-18T00:00:26.5510405Z remote: Counting objects:  20% (128/639)        
2024-12-18T00:00:26.5510933Z remote: Counting objects:  21% (135/639)        
2024-12-18T00:00:26.5511433Z remote: Counting objects:  22% (141/639)        
2024-12-18T00:00:26.5511925Z remote: Counting objects:  23% (147/639)        
2024-12-18T00:00:26.5512413Z remote: Counting objects:  24% (154/639)        
2024-12-18T00:00:26.5512875Z remote: Counting objects:  25% (160/639)        
2024-12-18T00:00:26.5513370Z remote: Counting objects:  26% (167/639)        
2024-12-18T00:00:26.5513949Z remote: Counting objects:  27% (173/639)        
2024-12-18T00:00:26.5514441Z remote: Counting objects:  28% (179/639)        
2024-12-18T00:00:26.5515187Z remote: Counting objects:  29% (186/639)        
2024-12-18T00:00:26.5515758Z remote: Counting objects:  30% (192/639)        
2024-12-18T00:00:26.5516249Z remote: Counting objects:  31% (199/639)        
2024-12-18T00:00:26.5516740Z remote: Counting objects:  32% (205/639)        
2024-12-18T00:00:26.5517245Z remote: Counting objects:  33% (211/639)        
2024-12-18T00:00:26.5517735Z remote: Counting objects:  34% (218/639)        
2024-12-18T00:00:26.5518218Z remote: Counting objects:  35% (224/639)        
2024-12-18T00:00:26.5518689Z remote: Counting objects:  36% (231/639)        
2024-12-18T00:00:26.5519173Z remote: Counting objects:  37% (237/639)        
2024-12-18T00:00:26.5519656Z remote: Counting objects:  38% (243/639)        
2024-12-18T00:00:26.5520175Z remote: Counting objects:  39% (250/639)        
2024-12-18T00:00:26.5520660Z remote: Counting objects:  40% (256/639)        
2024-12-18T00:00:26.5521145Z remote: Counting objects:  41% (262/639)        
2024-12-18T00:00:26.5521611Z remote: Counting objects:  42% (269/639)        
2024-12-18T00:00:26.5522166Z remote: Counting objects:  43% (275/639)        
2024-12-18T00:00:26.5522651Z remote: Counting objects:  44% (282/639)        
2024-12-18T00:00:26.5523136Z remote: Counting objects:  45% (288/639)        
2024-12-18T00:00:26.5523632Z remote: Counting objects:  46% (294/639)        
2024-12-18T00:00:26.5524104Z remote: Counting objects:  47% (301/639)        
2024-12-18T00:00:26.5524588Z remote: Counting objects:  48% (307/639)        
2024-12-18T00:00:26.5525073Z remote: Counting objects:  49% (314/639)        
2024-12-18T00:00:26.5525557Z remote: Counting objects:  50% (320/639)        
2024-12-18T00:00:26.5526048Z remote: Counting objects:  51% (326/639)        
2024-12-18T00:00:26.5526681Z remote: Counting objects:  52% (333/639)        
2024-12-18T00:00:26.5527153Z remote: Counting objects:  53% (339/639)        
2024-12-18T00:00:26.5527637Z remote: Counting objects:  54% (346/639)        
2024-12-18T00:00:26.5528123Z remote: Counting objects:  55% (352/639)        
2024-12-18T00:00:26.5528611Z remote: Counting objects:  56% (358/639)        
2024-12-18T00:00:26.5529153Z remote: Counting objects:  57% (365/639)        
2024-12-18T00:00:26.5529651Z remote: Counting objects:  58% (371/639)        
2024-12-18T00:00:26.5530120Z remote: Counting objects:  59% (378/639)        
2024-12-18T00:00:26.5530613Z remote: Counting objects:  60% (384/639)        
2024-12-18T00:00:26.5531098Z remote: Counting objects:  61% (390/639)        
2024-12-18T00:00:26.5531583Z remote: Counting objects:  62% (397/639)        
2024-12-18T00:00:26.5532103Z remote: Counting objects:  63% (403/639)        
2024-12-18T00:00:26.5532597Z remote: Counting objects:  64% (409/639)        
2024-12-18T00:00:26.5533072Z remote: Counting objects:  65% (416/639)        
2024-12-18T00:00:26.5533558Z remote: Counting objects:  66% (422/639)        
2024-12-18T00:00:26.5534040Z remote: Counting objects:  67% (429/639)        
2024-12-18T00:00:26.5534521Z remote: Counting objects:  68% (435/639)        
2024-12-18T00:00:26.5535006Z remote: Counting objects:  69% (441/639)        
2024-12-18T00:00:26.5535485Z remote: Counting objects:  70% (448/639)        
2024-12-18T00:00:26.5535952Z remote: Counting objects:  71% (454/639)        
2024-12-18T00:00:26.5536438Z remote: Counting objects:  72% (461/639)        
2024-12-18T00:00:26.5537023Z remote: Counting objects:  73% (467/639)        
2024-12-18T00:00:26.5537547Z remote: Counting objects:  74% (473/639)        
2024-12-18T00:00:26.5538028Z remote: Counting objects:  75% (480/639)        
2024-12-18T00:00:26.5538491Z remote: Counting objects:  76% (486/639)        
2024-12-18T00:00:26.5538976Z remote: Counting objects:  77% (493/639)        
2024-12-18T00:00:26.5539471Z remote: Counting objects:  78% (499/639)        
2024-12-18T00:00:26.5539956Z remote: Counting objects:  79% (505/639)        
2024-12-18T00:00:26.5540438Z remote: Counting objects:  80% (512/639)        
2024-12-18T00:00:26.5540905Z remote: Counting objects:  81% (518/639)        
2024-12-18T00:00:26.5541395Z remote: Counting objects:  82% (524/639)        
2024-12-18T00:00:26.5541882Z remote: Counting objects:  83% (531/639)        
2024-12-18T00:00:26.5542370Z remote: Counting objects:  84% (537/639)        
2024-12-18T00:00:26.5542855Z remote: Counting objects:  85% (544/639)        
2024-12-18T00:00:26.5543350Z remote: Counting objects:  86% (550/639)        
2024-12-18T00:00:26.5543822Z remote: Counting objects:  87% (556/639)        
2024-12-18T00:00:26.5544312Z remote: Counting objects:  88% (563/639)        
2024-12-18T00:00:26.5544797Z remote: Counting objects:  89% (569/639)        
2024-12-18T00:00:26.5545285Z remote: Counting objects:  90% (576/639)        
2024-12-18T00:00:26.5545781Z remote: Counting objects:  91% (582/639)        
2024-12-18T00:00:26.5546250Z remote: Counting objects:  92% (588/639)        
2024-12-18T00:00:26.5546761Z remote: Counting objects:  93% (595/639)        
2024-12-18T00:00:26.5547496Z remote: Counting objects:  94% (601/639)        
2024-12-18T00:00:26.5547994Z remote: Counting objects:  95% (608/639)        
2024-12-18T00:00:26.5548492Z remote: Counting objects:  96% (614/639)        
2024-12-18T00:00:26.5548964Z remote: Counting objects:  97% (620/639)        
2024-12-18T00:00:26.5549452Z remote: Counting objects:  98% (627/639)        
2024-12-18T00:00:26.5549948Z remote: Counting objects:  99% (633/639)        
2024-12-18T00:00:26.5550435Z remote: Counting objects: 100% (639/639)        
2024-12-18T00:00:26.5550954Z remote: Counting objects: 100% (639/639), done.        
2024-12-18T00:00:26.5551482Z remote: Compressing objects:   0% (1/297)        
2024-12-18T00:00:26.5661822Z remote: Compressing objects:   1% (3/297)        
2024-12-18T00:00:26.5805589Z remote: Compressing objects:   2% (6/297)        
2024-12-18T00:00:26.5950958Z remote: Compressing objects:   3% (9/297)        
2024-12-18T00:00:26.5986050Z remote: Compressing objects:   4% (12/297)        
2024-12-18T00:00:26.6082297Z remote: Compressing objects:   5% (15/297)        
2024-12-18T00:00:26.6136694Z remote: Compressing objects:   6% (18/297)        
2024-12-18T00:00:26.6276956Z remote: Compressing objects:   7% (21/297)        
2024-12-18T00:00:26.6542491Z remote: Compressing objects:   8% (24/297)        
2024-12-18T00:00:26.6943602Z remote: Compressing objects:   9% (27/297)        
2024-12-18T00:00:26.7644469Z remote: Compressing objects:  10% (30/297)        
2024-12-18T00:00:26.8090472Z remote: Compressing objects:  11% (33/297)        
2024-12-18T00:00:26.8287869Z remote: Compressing objects:  12% (36/297)        
2024-12-18T00:00:26.8330830Z remote: Compressing objects:  13% (39/297)        
2024-12-18T00:00:26.8332793Z remote: Compressing objects:  14% (42/297)        
2024-12-18T00:00:26.8335376Z remote: Compressing objects:  15% (45/297)        
2024-12-18T00:00:26.8339938Z remote: Compressing objects:  16% (48/297)        
2024-12-18T00:00:26.8341922Z remote: Compressing objects:  17% (51/297)        
2024-12-18T00:00:26.8348754Z remote: Compressing objects:  18% (54/297)        
2024-12-18T00:00:26.8349647Z remote: Compressing objects:  19% (57/297)        
2024-12-18T00:00:26.8350653Z remote: Compressing objects:  20% (60/297)        
2024-12-18T00:00:26.8351938Z remote: Compressing objects:  21% (63/297)        
2024-12-18T00:00:26.8354706Z remote: Compressing objects:  22% (66/297)        
2024-12-18T00:00:26.8359722Z remote: Compressing objects:  23% (69/297)        
2024-12-18T00:00:26.8364258Z remote: Compressing objects:  24% (72/297)        
2024-12-18T00:00:26.8368920Z remote: Compressing objects:  25% (75/297)        
2024-12-18T00:00:26.8370772Z remote: Compressing objects:  26% (78/297)        
2024-12-18T00:00:26.8371645Z remote: Compressing objects:  27% (81/297)        
2024-12-18T00:00:26.8374904Z remote: Compressing objects:  28% (84/297)        
2024-12-18T00:00:26.8375766Z remote: Compressing objects:  29% (87/297)        
2024-12-18T00:00:26.8381916Z remote: Compressing objects:  30% (90/297)        
2024-12-18T00:00:26.8388291Z remote: Compressing objects:  31% (93/297)        
2024-12-18T00:00:26.8396887Z remote: Compressing objects:  32% (96/297)        
2024-12-18T00:00:26.8403335Z remote: Compressing objects:  33% (99/297)        
2024-12-18T00:00:26.8403851Z remote: Compressing objects:  34% (101/297)        
2024-12-18T00:00:26.8404529Z remote: Compressing objects:  35% (104/297)        
2024-12-18T00:00:26.8412542Z remote: Compressing objects:  36% (107/297)        
2024-12-18T00:00:26.8415019Z remote: Compressing objects:  37% (110/297)        
2024-12-18T00:00:26.8420706Z remote: Compressing objects:  38% (113/297)        
2024-12-18T00:00:26.8427114Z remote: Compressing objects:  39% (116/297)        
2024-12-18T00:00:26.8432825Z remote: Compressing objects:  40% (119/297)        
2024-12-18T00:00:26.8434814Z remote: Compressing objects:  41% (122/297)        
2024-12-18T00:00:26.8438703Z remote: Compressing objects:  42% (125/297)        
2024-12-18T00:00:26.8440809Z remote: Compressing objects:  43% (128/297)        
2024-12-18T00:00:26.8444777Z remote: Compressing objects:  44% (131/297)        
2024-12-18T00:00:26.8451013Z remote: Compressing objects:  45% (134/297)        
2024-12-18T00:00:26.8453723Z remote: Compressing objects:  46% (137/297)        
2024-12-18T00:00:26.8455879Z remote: Compressing objects:  47% (140/297)        
2024-12-18T00:00:26.8461676Z remote: Compressing objects:  48% (143/297)        
2024-12-18T00:00:26.8466338Z remote: Compressing objects:  49% (146/297)        
2024-12-18T00:00:26.8467426Z remote: Compressing objects:  50% (149/297)        
2024-12-18T00:00:26.8473124Z remote: Compressing objects:  51% (152/297)        
2024-12-18T00:00:26.8475180Z remote: Compressing objects:  52% (155/297)        
2024-12-18T00:00:26.8477291Z remote: Compressing objects:  53% (158/297)        
2024-12-18T00:00:26.8480336Z remote: Compressing objects:  54% (161/297)        
2024-12-18T00:00:26.8482716Z remote: Compressing objects:  55% (164/297)        
2024-12-18T00:00:26.8484528Z remote: Compressing objects:  56% (167/297)        
2024-12-18T00:00:26.8487009Z remote: Compressing objects:  57% (170/297)        
2024-12-18T00:00:26.8489985Z remote: Compressing objects:  58% (173/297)        
2024-12-18T00:00:26.8491649Z remote: Compressing objects:  59% (176/297)        
2024-12-18T00:00:26.8493878Z remote: Compressing objects:  60% (179/297)        
2024-12-18T00:00:26.8496577Z remote: Compressing objects:  61% (182/297)        
2024-12-18T00:00:26.8499026Z remote: Compressing objects:  62% (185/297)        
2024-12-18T00:00:26.8502371Z remote: Compressing objects:  63% (188/297)        
2024-12-18T00:00:26.8504672Z remote: Compressing objects:  64% (191/297)        
2024-12-18T00:00:26.8509384Z remote: Compressing objects:  65% (194/297)        
2024-12-18T00:00:26.8510174Z remote: Compressing objects:  66% (197/297)        
2024-12-18T00:00:26.8511245Z remote: Compressing objects:  67% (199/297)        
2024-12-18T00:00:26.8515881Z remote: Compressing objects:  68% (202/297)        
2024-12-18T00:00:26.8521253Z remote: Compressing objects:  69% (205/297)        
2024-12-18T00:00:26.8523303Z remote: Compressing objects:  70% (208/297)        
2024-12-18T00:00:26.8525107Z remote: Compressing objects:  71% (211/297)        
2024-12-18T00:00:26.8527344Z remote: Compressing objects:  72% (214/297)        
2024-12-18T00:00:26.8528615Z remote: Compressing objects:  73% (217/297)        
2024-12-18T00:00:26.8529541Z remote: Compressing objects:  74% (220/297)        
2024-12-18T00:00:26.8531396Z remote: Compressing objects:  75% (223/297)        
2024-12-18T00:00:26.8532234Z remote: Compressing objects:  76% (226/297)        
2024-12-18T00:00:26.8534458Z remote: Compressing objects:  77% (229/297)        
2024-12-18T00:00:26.8534971Z remote: Compressing objects:  78% (232/297)        
2024-12-18T00:00:26.8537086Z remote: Compressing objects:  79% (235/297)        
2024-12-18T00:00:26.8537884Z remote: Compressing objects:  80% (238/297)        
2024-12-18T00:00:26.8541897Z remote: Compressing objects:  81% (241/297)        
2024-12-18T00:00:26.8544273Z remote: Compressing objects:  82% (244/297)        
2024-12-18T00:00:26.8545143Z remote: Compressing objects:  83% (247/297)        
2024-12-18T00:00:26.8546148Z remote: Compressing objects:  84% (250/297)        
2024-12-18T00:00:26.8548222Z remote: Compressing objects:  85% (253/297)        
2024-12-18T00:00:26.8549219Z remote: Compressing objects:  86% (256/297)        
2024-12-18T00:00:26.8550166Z remote: Compressing objects:  87% (259/297)        
2024-12-18T00:00:26.8552414Z remote: Compressing objects:  88% (262/297)        
2024-12-18T00:00:26.8553159Z remote: Compressing objects:  89% (265/297)        
2024-12-18T00:00:26.8554222Z remote: Compressing objects:  90% (268/297)        
2024-12-18T00:00:26.8555183Z remote: Compressing objects:  91% (271/297)        
2024-12-18T00:00:26.8556195Z remote: Compressing objects:  92% (274/297)        
2024-12-18T00:00:26.8561335Z remote: Compressing objects:  93% (277/297)        
2024-12-18T00:00:26.8562087Z remote: Compressing objects:  94% (280/297)        
2024-12-18T00:00:26.8563126Z remote: Compressing objects:  95% (283/297)        
2024-12-18T00:00:26.8564077Z remote: Compressing objects:  96% (286/297)        
2024-12-18T00:00:26.8565187Z remote: Compressing objects:  97% (289/297)        
2024-12-18T00:00:26.8565690Z remote: Compressing objects:  98% (292/297)        
2024-12-18T00:00:26.8566243Z remote: Compressing objects:  99% (295/297)        
2024-12-18T00:00:26.8567144Z remote: Compressing objects: 100% (297/297)        
2024-12-18T00:00:26.8567682Z remote: Compressing objects: 100% (297/297), done.        
2024-12-18T00:00:55.2135452Z remote: Total 1057261 (delta 491), reused 366 (delta 342), pack-reused 1056622 (from 5)        
2024-12-18T00:01:23.4377632Z [command]/usr/bin/git rev-parse --verify --quiet 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7^{object}
2024-12-18T00:01:23.4402118Z 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:01:23.4407507Z ##[endgroup]
2024-12-18T00:01:23.4408109Z ##[group]Determining the checkout info
2024-12-18T00:01:23.4409256Z ##[endgroup]
2024-12-18T00:01:23.4409793Z ##[group]Checking out the ref
2024-12-18T00:01:23.4413602Z [command]/usr/bin/git checkout --quiet --force 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:01:25.4571786Z ##[endgroup]
2024-12-18T00:01:25.4572394Z ##[group]Setting up auth for fetching submodules
2024-12-18T00:01:25.4577029Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic ***
2024-12-18T00:01:25.4627305Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf
2024-12-18T00:01:25.4655211Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com:
2024-12-18T00:01:25.4684114Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com:
2024-12-18T00:01:25.4713358Z ##[endgroup]
2024-12-18T00:01:25.4713893Z ##[group]Fetching submodules
2024-12-18T00:01:25.4716781Z [command]/usr/bin/git submodule sync --recursive
2024-12-18T00:01:25.5068046Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive
2024-12-18T00:01:25.5411476Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni'
2024-12-18T00:01:25.5414722Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16'
2024-12-18T00:01:25.5418201Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv'
2024-12-18T00:01:25.5421919Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK'
2024-12-18T00:01:25.5425792Z Submodule 'third_party/NVTX' (https://github.com/NVIDIA/NVTX.git) registered for path 'third_party/NVTX'
2024-12-18T00:01:25.5430333Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator'
2024-12-18T00:01:25.5434135Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK'
2024-12-18T00:01:25.5438582Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark'
2024-12-18T00:01:25.5443164Z Submodule 'third_party/composable_kernel' (https://github.com/ROCm/composable_kernel.git) registered for path 'third_party/composable_kernel'
2024-12-18T00:01:25.5447689Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib'
2024-12-18T00:01:25.5452244Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo'
2024-12-18T00:01:25.5457531Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend'
2024-12-18T00:01:25.5462352Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass'
2024-12-18T00:01:25.5467446Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen'
2024-12-18T00:01:25.5472583Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm'
2024-12-18T00:01:25.5477952Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers'
2024-12-18T00:01:25.5485516Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt'
2024-12-18T00:01:25.5491329Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp'
2024-12-18T00:01:25.5496831Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo'
2024-12-18T00:01:25.5502792Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest'
2024-12-18T00:01:25.5508576Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep'
2024-12-18T00:01:25.5514615Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi'
2024-12-18T00:01:25.5520764Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto'
2024-12-18T00:01:25.5527046Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc'
2024-12-18T00:01:25.5533293Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl'
2024-12-18T00:01:25.5539763Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann'
2024-12-18T00:01:25.5546208Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx'
2024-12-18T00:01:25.5553258Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp'
2024-12-18T00:01:25.5560335Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft'
2024-12-18T00:01:25.5567453Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf'
2024-12-18T00:01:25.5574194Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd'
2024-12-18T00:01:25.5581409Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool'
2024-12-18T00:01:25.5588510Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11'
2024-12-18T00:01:25.5597841Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy'
2024-12-18T00:01:25.5605350Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef'
2024-12-18T00:01:25.5612944Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe'
2024-12-18T00:01:25.5646583Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'...
2024-12-18T00:01:25.9066813Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'...
2024-12-18T00:01:26.1366241Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'...
2024-12-18T00:01:26.4150211Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'...
2024-12-18T00:01:26.7198766Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NVTX'...
2024-12-18T00:01:27.0950965Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'...
2024-12-18T00:01:29.2837100Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'...
2024-12-18T00:01:43.6023418Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'...
2024-12-18T00:01:44.1232070Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/composable_kernel'...
2024-12-18T00:01:46.6578175Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'...
2024-12-18T00:01:47.2783466Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'...
2024-12-18T00:01:47.9916614Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'...
2024-12-18T00:01:49.4500679Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'...
2024-12-18T00:01:52.0105384Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'...
2024-12-18T00:01:59.6406570Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'...
2024-12-18T00:02:01.6361015Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'...
2024-12-18T00:02:03.1857007Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'...
2024-12-18T00:02:04.6819032Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'...
2024-12-18T00:02:05.1915258Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'...
2024-12-18T00:02:05.5948597Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'...
2024-12-18T00:02:06.8845004Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'...
2024-12-18T00:02:07.3399601Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'...
2024-12-18T00:02:07.6567204Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'...
2024-12-18T00:02:09.5348475Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'...
2024-12-18T00:02:10.5118781Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'...
2024-12-18T00:02:10.9478234Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'...
2024-12-18T00:02:19.3605808Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'...
2024-12-18T00:02:21.9548149Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'...
2024-12-18T00:02:28.3664173Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'...
2024-12-18T00:02:28.6400423Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'...
2024-12-18T00:02:39.9636433Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'...
2024-12-18T00:02:40.1975708Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'...
2024-12-18T00:02:40.4241017Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'...
2024-12-18T00:02:41.7261603Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'...
2024-12-18T00:02:42.1462053Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'...
2024-12-18T00:02:42.8506163Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'...
2024-12-18T00:02:43.3970614Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f'
2024-12-18T00:02:43.4119422Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3'
2024-12-18T00:02:43.4232738Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1'
2024-12-18T00:02:43.4580619Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73'
2024-12-18T00:02:43.5059277Z Submodule path 'third_party/NVTX': checked out 'e170594ac7cf1dac584da473d4ca9301087090c1'
2024-12-18T00:02:43.5536403Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191'
2024-12-18T00:02:44.6246222Z Submodule path 'third_party/XNNPACK': checked out '4ea82e595b36106653175dcb04b2aa532660d0d8'
2024-12-18T00:02:44.6558399Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415'
2024-12-18T00:02:44.9902183Z Submodule path 'third_party/composable_kernel': checked out '50ee4267e27b875d149e642f4cebd47be1dc3b57'
2024-12-18T00:02:45.0518408Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006'
2024-12-18T00:02:45.1840673Z Submodule path 'third_party/cpuinfo': checked out '1e83a2fdd3102f65c6f1fb602c1b320486218a99'
2024-12-18T00:02:45.2293649Z Submodule path 'third_party/cudnn_frontend': checked out '936021bfed8c91dc416af1588b2c4eca631a9e45'
2024-12-18T00:02:45.9356809Z Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49'
2024-12-18T00:02:46.2741660Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c'
2024-12-18T00:02:46.3983839Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e'
2024-12-18T00:02:46.4006404Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit'
2024-12-18T00:02:46.4010344Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo'
2024-12-18T00:02:46.4014154Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass'
2024-12-18T00:02:46.4018172Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest'
2024-12-18T00:02:46.4022255Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch'
2024-12-18T00:02:46.4054934Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'...
2024-12-18T00:02:47.3880778Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'...
2024-12-18T00:02:48.0978495Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'...
2024-12-18T00:02:50.7328443Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'...
2024-12-18T00:02:52.0416395Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'...
2024-12-18T00:02:52.4628248Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81'
2024-12-18T00:02:52.5900672Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3'
2024-12-18T00:02:53.1706865Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6'
2024-12-18T00:02:53.2510266Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796'
2024-12-18T00:02:53.2664644Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1'
2024-12-18T00:02:53.4501348Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b'
2024-12-18T00:02:53.5001891Z Submodule path 'third_party/fmt': checked out '0c9fce2ffefecfdce794e1859584e25877b7b592'
2024-12-18T00:02:53.5509439Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350'
2024-12-18T00:02:53.5863457Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509'
2024-12-18T00:02:53.6426097Z Submodule path 'third_party/googletest': checked out 'b514bdc898e2951020cbdca1304b75f5950d1f59'
2024-12-18T00:02:53.6590885Z Submodule path 'third_party/ideep': checked out 'c7ccd5bdbe5434ba156f4e856dcef0601637334b'
2024-12-18T00:02:53.6610816Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn'
2024-12-18T00:02:53.6641215Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'...
2024-12-18T00:03:10.2334138Z Submodule path 'third_party/ideep/mkl-dnn': checked out '66f0cb9eb66affd2da3bf5f8d897376f04aae6af'
2024-12-18T00:03:10.2564824Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42'
2024-12-18T00:03:10.3680326Z Submodule path 'third_party/kineto': checked out '338140f58a28d599da3434ced4fd2d75dd1a213d'
2024-12-18T00:03:10.3702269Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog'
2024-12-18T00:03:10.3706052Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt'
2024-12-18T00:03:10.3710139Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest'
2024-12-18T00:03:10.3741701Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'...
2024-12-18T00:03:11.3424544Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'...
2024-12-18T00:03:12.8293474Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'...
2024-12-18T00:03:14.1829202Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e'
2024-12-18T00:03:14.1849942Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-12-18T00:03:14.1853973Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-12-18T00:03:14.1857829Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-12-18T00:03:14.1861951Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-12-18T00:03:14.1866106Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-12-18T00:03:14.1871043Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-12-18T00:03:14.1875501Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-12-18T00:03:14.1880033Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-12-18T00:03:14.1915115Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'...
2024-12-18T00:03:15.2800929Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'...
2024-12-18T00:03:15.6987753Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'...
2024-12-18T00:03:17.7912808Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'...
2024-12-18T00:03:18.2003818Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'...
2024-12-18T00:03:18.7482303Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'...
2024-12-18T00:03:20.0063341Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'...
2024-12-18T00:03:28.5331418Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'...
2024-12-18T00:03:29.0141765Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9'
2024-12-18T00:03:29.0389696Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400'
2024-12-18T00:03:29.0850278Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05'
2024-12-18T00:03:29.1024235Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067'
2024-12-18T00:03:29.1044142Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-12-18T00:03:29.1075295Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'...
2024-12-18T00:03:29.4511512Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4'
2024-12-18T00:03:29.4758133Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446'
2024-12-18T00:03:29.5292340Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850'
2024-12-18T00:03:29.6626378Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5'
2024-12-18T00:03:29.6839617Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150'
2024-12-18T00:03:29.7324868Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '0041a40c1350ba702d475b9c4ad62da77caea164'
2024-12-18T00:03:29.8068669Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347'
2024-12-18T00:03:29.8558816Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78'
2024-12-18T00:03:29.8935571Z Submodule path 'third_party/nccl/nccl': checked out 'ab2b89c4c339bd7f816fbc114a4b05d386b66290'
2024-12-18T00:03:30.0451057Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806'
2024-12-18T00:03:30.5640638Z Submodule path 'third_party/onnx': checked out 'b8baa8446686496da4cc8fda09f2b6fe65c2a02c'
2024-12-18T00:03:30.5683231Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11'
2024-12-18T00:03:30.5715321Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'...
2024-12-18T00:03:31.9474656Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '3e9dfa2866941655c56877882565e7577de6fc7b'
2024-12-18T00:03:32.0456918Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878'
2024-12-18T00:03:32.0479182Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-12-18T00:03:32.0483090Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest'
2024-12-18T00:03:32.0487057Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-12-18T00:03:32.0491120Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-12-18T00:03:32.0495504Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-12-18T00:03:32.0499623Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-12-18T00:03:32.0503911Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-12-18T00:03:32.0508934Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-12-18T00:03:32.0539964Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'...
2024-12-18T00:03:32.5601926Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'...
2024-12-18T00:03:33.7897863Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'...
2024-12-18T00:03:34.1738089Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'...
2024-12-18T00:03:42.5930763Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'...
2024-12-18T00:03:42.9104689Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'...
2024-12-18T00:03:43.1882225Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'...
2024-12-18T00:03:43.5380938Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'...
2024-12-18T00:03:52.2228162Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2'
2024-12-18T00:03:52.2765063Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1'
2024-12-18T00:03:52.2967182Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa'
2024-12-18T00:03:52.4368163Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d'
2024-12-18T00:03:52.4539578Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce'
2024-12-18T00:03:52.4733914Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5'
2024-12-18T00:03:52.4940607Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d'
2024-12-18T00:03:52.4961430Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-12-18T00:03:52.4965345Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-12-18T00:03:52.4996129Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'...
2024-12-18T00:03:54.8114073Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'...
2024-12-18T00:03:56.4004588Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4'
2024-12-18T00:03:56.4607026Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929'
2024-12-18T00:03:57.1784122Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50'
2024-12-18T00:03:57.1929910Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe'
2024-12-18T00:03:57.5754401Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a'
2024-12-18T00:03:57.5781715Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark'
2024-12-18T00:03:57.5786314Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest'
2024-12-18T00:03:57.5820930Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'...
2024-12-18T00:03:58.1185011Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'...
2024-12-18T00:03:59.4364941Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8'
2024-12-18T00:03:59.5315887Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081'
2024-12-18T00:03:59.5430374Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900'
2024-12-18T00:03:59.5590390Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8'
2024-12-18T00:03:59.6070489Z Submodule path 'third_party/pybind11': checked out 'a2e59f0e7065404b44dfe92a28aca47ba1378dc4'
2024-12-18T00:03:59.6452810Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67'
2024-12-18T00:03:59.7014420Z Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b'
2024-12-18T00:03:59.7391132Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e'
2024-12-18T00:03:59.7413913Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest'
2024-12-18T00:03:59.7417486Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop'
2024-12-18T00:03:59.7421499Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv'
2024-12-18T00:03:59.7425649Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11'
2024-12-18T00:03:59.7457480Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'...
2024-12-18T00:04:01.0844864Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'...
2024-12-18T00:04:01.3569363Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'...
2024-12-18T00:04:03.8986859Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'...
2024-12-18T00:04:05.3345347Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e'
2024-12-18T00:04:05.3561900Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281'
2024-12-18T00:04:05.4393478Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242'
2024-12-18T00:04:05.4775407Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef'
2024-12-18T00:04:05.4795036Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-12-18T00:04:05.4826987Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'...
2024-12-18T00:04:05.7582279Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5'
2024-12-18T00:04:05.7623474Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0
2024-12-18T00:04:05.7972311Z Entering 'android/libs/fbjni'
2024-12-18T00:04:05.8022289Z Entering 'third_party/FP16'
2024-12-18T00:04:05.8076527Z Entering 'third_party/FXdiv'
2024-12-18T00:04:05.8125669Z Entering 'third_party/NNPACK'
2024-12-18T00:04:05.8175976Z Entering 'third_party/NVTX'
2024-12-18T00:04:05.8225759Z Entering 'third_party/VulkanMemoryAllocator'
2024-12-18T00:04:05.8275227Z Entering 'third_party/XNNPACK'
2024-12-18T00:04:05.8342065Z Entering 'third_party/benchmark'
2024-12-18T00:04:05.8393581Z Entering 'third_party/composable_kernel'
2024-12-18T00:04:05.8450691Z Entering 'third_party/cpp-httplib'
2024-12-18T00:04:05.8501881Z Entering 'third_party/cpuinfo'
2024-12-18T00:04:05.8553293Z Entering 'third_party/cudnn_frontend'
2024-12-18T00:04:05.8602703Z Entering 'third_party/cutlass'
2024-12-18T00:04:05.8662972Z Entering 'third_party/eigen'
2024-12-18T00:04:05.8714439Z Entering 'third_party/fbgemm'
2024-12-18T00:04:05.8766099Z Entering 'third_party/fbgemm/third_party/asmjit'
2024-12-18T00:04:05.8814819Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2024-12-18T00:04:05.8865020Z Entering 'third_party/fbgemm/third_party/cutlass'
2024-12-18T00:04:05.8922032Z Entering 'third_party/fbgemm/third_party/googletest'
2024-12-18T00:04:05.8972082Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2024-12-18T00:04:05.9021376Z Entering 'third_party/flatbuffers'
2024-12-18T00:04:05.9075188Z Entering 'third_party/fmt'
2024-12-18T00:04:05.9124405Z Entering 'third_party/gemmlowp/gemmlowp'
2024-12-18T00:04:05.9175910Z Entering 'third_party/gloo'
2024-12-18T00:04:05.9224502Z Entering 'third_party/googletest'
2024-12-18T00:04:05.9274910Z Entering 'third_party/ideep'
2024-12-18T00:04:05.9324233Z Entering 'third_party/ideep/mkl-dnn'
2024-12-18T00:04:05.9382505Z Entering 'third_party/ittapi'
2024-12-18T00:04:05.9431488Z Entering 'third_party/kineto'
2024-12-18T00:04:05.9483362Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2024-12-18T00:04:05.9532821Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-12-18T00:04:05.9583982Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-12-18T00:04:05.9633215Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-12-18T00:04:05.9683218Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-12-18T00:04:05.9731354Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-12-18T00:04:05.9784029Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-12-18T00:04:05.9832564Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-12-18T00:04:05.9882363Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-12-18T00:04:05.9932089Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-12-18T00:04:05.9985223Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2024-12-18T00:04:06.0033789Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2024-12-18T00:04:06.0085562Z Entering 'third_party/mimalloc'
2024-12-18T00:04:06.0136340Z Entering 'third_party/nccl/nccl'
2024-12-18T00:04:06.0188901Z Entering 'third_party/nlohmann'
2024-12-18T00:04:06.0242092Z Entering 'third_party/onnx'
2024-12-18T00:04:06.0310770Z Entering 'third_party/onnx/third_party/pybind11'
2024-12-18T00:04:06.0365194Z Entering 'third_party/opentelemetry-cpp'
2024-12-18T00:04:06.0417933Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-12-18T00:04:06.0468282Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2024-12-18T00:04:06.0518246Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-12-18T00:04:06.0567925Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-12-18T00:04:06.0618216Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-12-18T00:04:06.0669541Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-12-18T00:04:06.0717711Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-12-18T00:04:06.0767792Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-12-18T00:04:06.0819172Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-12-18T00:04:06.0870490Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-12-18T00:04:06.0942508Z Entering 'third_party/pocketfft'
2024-12-18T00:04:06.0992582Z Entering 'third_party/protobuf'
2024-12-18T00:04:06.1046535Z Entering 'third_party/protobuf/third_party/benchmark'
2024-12-18T00:04:06.1096675Z Entering 'third_party/protobuf/third_party/googletest'
2024-12-18T00:04:06.1147567Z Entering 'third_party/psimd'
2024-12-18T00:04:06.1197982Z Entering 'third_party/pthreadpool'
2024-12-18T00:04:06.1247152Z Entering 'third_party/pybind11'
2024-12-18T00:04:06.1297100Z Entering 'third_party/python-peachpy'
2024-12-18T00:04:06.1346005Z Entering 'third_party/sleef'
2024-12-18T00:04:06.1398181Z Entering 'third_party/tensorpipe'
2024-12-18T00:04:06.1447387Z Entering 'third_party/tensorpipe/third_party/googletest'
2024-12-18T00:04:06.1499251Z Entering 'third_party/tensorpipe/third_party/libnop'
2024-12-18T00:04:06.1547078Z Entering 'third_party/tensorpipe/third_party/libuv'
2024-12-18T00:04:06.1596183Z Entering 'third_party/tensorpipe/third_party/pybind11'
2024-12-18T00:04:06.1644589Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-12-18T00:04:06.1711622Z ##[endgroup]
2024-12-18T00:04:06.1714841Z ##[group]Persisting credentials for submodules
2024-12-18T00:04:06.1716451Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :"
2024-12-18T00:04:06.2066346Z Entering 'android/libs/fbjni'
2024-12-18T00:04:06.2130331Z Entering 'third_party/FP16'
2024-12-18T00:04:06.2195260Z Entering 'third_party/FXdiv'
2024-12-18T00:04:06.2260784Z Entering 'third_party/NNPACK'
2024-12-18T00:04:06.2325145Z Entering 'third_party/NVTX'
2024-12-18T00:04:06.2390742Z Entering 'third_party/VulkanMemoryAllocator'
2024-12-18T00:04:06.2455600Z Entering 'third_party/XNNPACK'
2024-12-18T00:04:06.2538911Z Entering 'third_party/benchmark'
2024-12-18T00:04:06.2604925Z Entering 'third_party/composable_kernel'
2024-12-18T00:04:06.2678404Z Entering 'third_party/cpp-httplib'
2024-12-18T00:04:06.2742309Z Entering 'third_party/cpuinfo'
2024-12-18T00:04:06.2808248Z Entering 'third_party/cudnn_frontend'
2024-12-18T00:04:06.2873165Z Entering 'third_party/cutlass'
2024-12-18T00:04:06.2946390Z Entering 'third_party/eigen'
2024-12-18T00:04:06.3014693Z Entering 'third_party/fbgemm'
2024-12-18T00:04:06.3080711Z Entering 'third_party/fbgemm/third_party/asmjit'
2024-12-18T00:04:06.3145030Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2024-12-18T00:04:06.3210475Z Entering 'third_party/fbgemm/third_party/cutlass'
2024-12-18T00:04:06.3283800Z Entering 'third_party/fbgemm/third_party/googletest'
2024-12-18T00:04:06.3347820Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2024-12-18T00:04:06.3414678Z Entering 'third_party/flatbuffers'
2024-12-18T00:04:06.3482080Z Entering 'third_party/fmt'
2024-12-18T00:04:06.3545806Z Entering 'third_party/gemmlowp/gemmlowp'
2024-12-18T00:04:06.3610924Z Entering 'third_party/gloo'
2024-12-18T00:04:06.3675626Z Entering 'third_party/googletest'
2024-12-18T00:04:06.3739661Z Entering 'third_party/ideep'
2024-12-18T00:04:06.3803830Z Entering 'third_party/ideep/mkl-dnn'
2024-12-18T00:04:06.3875941Z Entering 'third_party/ittapi'
2024-12-18T00:04:06.3939525Z Entering 'third_party/kineto'
2024-12-18T00:04:06.4003772Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2024-12-18T00:04:06.4068404Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-12-18T00:04:06.4135313Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-12-18T00:04:06.4200496Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-12-18T00:04:06.4266691Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-12-18T00:04:06.4329181Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-12-18T00:04:06.4396430Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-12-18T00:04:06.4463360Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-12-18T00:04:06.4527530Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-12-18T00:04:06.4593601Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-12-18T00:04:06.4660210Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2024-12-18T00:04:06.4723932Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2024-12-18T00:04:06.4790070Z Entering 'third_party/mimalloc'
2024-12-18T00:04:06.4854194Z Entering 'third_party/nccl/nccl'
2024-12-18T00:04:06.4919116Z Entering 'third_party/nlohmann'
2024-12-18T00:04:06.4986719Z Entering 'third_party/onnx'
2024-12-18T00:04:06.5068560Z Entering 'third_party/onnx/third_party/pybind11'
2024-12-18T00:04:06.5134725Z Entering 'third_party/opentelemetry-cpp'
2024-12-18T00:04:06.5200819Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-12-18T00:04:06.5265241Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2024-12-18T00:04:06.5327911Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-12-18T00:04:06.5391492Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-12-18T00:04:06.5457858Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-12-18T00:04:06.5521434Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-12-18T00:04:06.5584259Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-12-18T00:04:06.5646164Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-12-18T00:04:06.5713193Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-12-18T00:04:06.5779431Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-12-18T00:04:06.5866068Z Entering 'third_party/pocketfft'
2024-12-18T00:04:06.5929616Z Entering 'third_party/protobuf'
2024-12-18T00:04:06.5997053Z Entering 'third_party/protobuf/third_party/benchmark'
2024-12-18T00:04:06.6061110Z Entering 'third_party/protobuf/third_party/googletest'
2024-12-18T00:04:06.6126988Z Entering 'third_party/psimd'
2024-12-18T00:04:06.6191318Z Entering 'third_party/pthreadpool'
2024-12-18T00:04:06.6255605Z Entering 'third_party/pybind11'
2024-12-18T00:04:06.6321370Z Entering 'third_party/python-peachpy'
2024-12-18T00:04:06.6386072Z Entering 'third_party/sleef'
2024-12-18T00:04:06.6449765Z Entering 'third_party/tensorpipe'
2024-12-18T00:04:06.6513796Z Entering 'third_party/tensorpipe/third_party/googletest'
2024-12-18T00:04:06.6577567Z Entering 'third_party/tensorpipe/third_party/libnop'
2024-12-18T00:04:06.6640098Z Entering 'third_party/tensorpipe/third_party/libuv'
2024-12-18T00:04:06.6705455Z Entering 'third_party/tensorpipe/third_party/pybind11'
2024-12-18T00:04:06.6767994Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-12-18T00:04:06.6851461Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url"
2024-12-18T00:04:06.7192068Z Entering 'android/libs/fbjni'
2024-12-18T00:04:06.7252113Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config	remote.origin.url
2024-12-18T00:04:06.7271355Z Entering 'third_party/FP16'
2024-12-18T00:04:06.7330807Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config	remote.origin.url
2024-12-18T00:04:06.7349559Z Entering 'third_party/FXdiv'
2024-12-18T00:04:06.7410429Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config	remote.origin.url
2024-12-18T00:04:06.7429048Z Entering 'third_party/NNPACK'
2024-12-18T00:04:06.7490414Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config	remote.origin.url
2024-12-18T00:04:06.7509658Z Entering 'third_party/NVTX'
2024-12-18T00:04:06.7571665Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config	remote.origin.url
2024-12-18T00:04:06.7590907Z Entering 'third_party/VulkanMemoryAllocator'
2024-12-18T00:04:06.7651089Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config	remote.origin.url
2024-12-18T00:04:06.7672092Z Entering 'third_party/XNNPACK'
2024-12-18T00:04:06.7732290Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config	remote.origin.url
2024-12-18T00:04:06.7769872Z Entering 'third_party/benchmark'
2024-12-18T00:04:06.7830216Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config	remote.origin.url
2024-12-18T00:04:06.7849463Z Entering 'third_party/composable_kernel'
2024-12-18T00:04:06.7911402Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/composable_kernel/config	remote.origin.url
2024-12-18T00:04:06.7936972Z Entering 'third_party/cpp-httplib'
2024-12-18T00:04:06.7998819Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config	remote.origin.url
2024-12-18T00:04:06.8017662Z Entering 'third_party/cpuinfo'
2024-12-18T00:04:06.8077535Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config	remote.origin.url
2024-12-18T00:04:06.8097301Z Entering 'third_party/cudnn_frontend'
2024-12-18T00:04:06.8158822Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config	remote.origin.url
2024-12-18T00:04:06.8179788Z Entering 'third_party/cutlass'
2024-12-18T00:04:06.8240150Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config	remote.origin.url
2024-12-18T00:04:06.8269329Z Entering 'third_party/eigen'
2024-12-18T00:04:06.8328856Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config	remote.origin.url
2024-12-18T00:04:06.8351124Z Entering 'third_party/fbgemm'
2024-12-18T00:04:06.8414518Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config	remote.origin.url
2024-12-18T00:04:06.8433562Z Entering 'third_party/fbgemm/third_party/asmjit'
2024-12-18T00:04:06.8495849Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config	remote.origin.url
2024-12-18T00:04:06.8514188Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2024-12-18T00:04:06.8575943Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config	remote.origin.url
2024-12-18T00:04:06.8594613Z Entering 'third_party/fbgemm/third_party/cutlass'
2024-12-18T00:04:06.8655289Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config	remote.origin.url
2024-12-18T00:04:06.8680662Z Entering 'third_party/fbgemm/third_party/googletest'
2024-12-18T00:04:06.8740430Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config	remote.origin.url
2024-12-18T00:04:06.8760700Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2024-12-18T00:04:06.8821428Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config	remote.origin.url
2024-12-18T00:04:06.8841895Z Entering 'third_party/flatbuffers'
2024-12-18T00:04:06.8903944Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config	remote.origin.url
2024-12-18T00:04:06.8925474Z Entering 'third_party/fmt'
2024-12-18T00:04:06.8987119Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config	remote.origin.url
2024-12-18T00:04:06.9005967Z Entering 'third_party/gemmlowp/gemmlowp'
2024-12-18T00:04:06.9067916Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config	remote.origin.url
2024-12-18T00:04:06.9087060Z Entering 'third_party/gloo'
2024-12-18T00:04:06.9148298Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config	remote.origin.url
2024-12-18T00:04:06.9168979Z Entering 'third_party/googletest'
2024-12-18T00:04:06.9229537Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config	remote.origin.url
2024-12-18T00:04:06.9249692Z Entering 'third_party/ideep'
2024-12-18T00:04:06.9312846Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config	remote.origin.url
2024-12-18T00:04:06.9330564Z Entering 'third_party/ideep/mkl-dnn'
2024-12-18T00:04:06.9390989Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config	remote.origin.url
2024-12-18T00:04:06.9419126Z Entering 'third_party/ittapi'
2024-12-18T00:04:06.9481300Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config	remote.origin.url
2024-12-18T00:04:06.9500627Z Entering 'third_party/kineto'
2024-12-18T00:04:06.9563255Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config	remote.origin.url
2024-12-18T00:04:06.9581866Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2024-12-18T00:04:06.9643651Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config	remote.origin.url
2024-12-18T00:04:06.9662839Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-12-18T00:04:06.9724802Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config	remote.origin.url
2024-12-18T00:04:06.9745508Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-12-18T00:04:06.9808235Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config	remote.origin.url
2024-12-18T00:04:06.9827740Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-12-18T00:04:06.9889576Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config	remote.origin.url
2024-12-18T00:04:06.9908621Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-12-18T00:04:06.9971888Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config	remote.origin.url
2024-12-18T00:04:06.9989521Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-12-18T00:04:07.0050847Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config	remote.origin.url
2024-12-18T00:04:07.0072037Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-12-18T00:04:07.0132823Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config	remote.origin.url
2024-12-18T00:04:07.0152486Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-12-18T00:04:07.0217016Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config	remote.origin.url
2024-12-18T00:04:07.0236848Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-12-18T00:04:07.0299367Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config	remote.origin.url
2024-12-18T00:04:07.0319980Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-12-18T00:04:07.0384150Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config	remote.origin.url
2024-12-18T00:04:07.0404935Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2024-12-18T00:04:07.0466989Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config	remote.origin.url
2024-12-18T00:04:07.0485752Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2024-12-18T00:04:07.0548107Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config	remote.origin.url
2024-12-18T00:04:07.0570294Z Entering 'third_party/mimalloc'
2024-12-18T00:04:07.0631281Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config	remote.origin.url
2024-12-18T00:04:07.0650407Z Entering 'third_party/nccl/nccl'
2024-12-18T00:04:07.0714104Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config	remote.origin.url
2024-12-18T00:04:07.0733228Z Entering 'third_party/nlohmann'
2024-12-18T00:04:07.0796576Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config	remote.origin.url
2024-12-18T00:04:07.0817106Z Entering 'third_party/onnx'
2024-12-18T00:04:07.0880448Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config	remote.origin.url
2024-12-18T00:04:07.0918950Z Entering 'third_party/onnx/third_party/pybind11'
2024-12-18T00:04:07.0981918Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config	remote.origin.url
2024-12-18T00:04:07.1003618Z Entering 'third_party/opentelemetry-cpp'
2024-12-18T00:04:07.1067269Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config	remote.origin.url
2024-12-18T00:04:07.1087823Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-12-18T00:04:07.1148864Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config	remote.origin.url
2024-12-18T00:04:07.1169620Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2024-12-18T00:04:07.1229797Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config	remote.origin.url
2024-12-18T00:04:07.1248682Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-12-18T00:04:07.1312817Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config	remote.origin.url
2024-12-18T00:04:07.1331152Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-12-18T00:04:07.1393041Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config	remote.origin.url
2024-12-18T00:04:07.1413397Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-12-18T00:04:07.1475472Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config	remote.origin.url
2024-12-18T00:04:07.1493338Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-12-18T00:04:07.1554149Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config	remote.origin.url
2024-12-18T00:04:07.1573335Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-12-18T00:04:07.1633930Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config	remote.origin.url
2024-12-18T00:04:07.1651636Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-12-18T00:04:07.1712891Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config	remote.origin.url
2024-12-18T00:04:07.1734645Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-12-18T00:04:07.1796396Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config	remote.origin.url
2024-12-18T00:04:07.1816616Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-12-18T00:04:07.1880195Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config	remote.origin.url
2024-12-18T00:04:07.1922033Z Entering 'third_party/pocketfft'
2024-12-18T00:04:07.1983205Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config	remote.origin.url
2024-12-18T00:04:07.2002040Z Entering 'third_party/protobuf'
2024-12-18T00:04:07.2065094Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config	remote.origin.url
2024-12-18T00:04:07.2087147Z Entering 'third_party/protobuf/third_party/benchmark'
2024-12-18T00:04:07.2150212Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config	remote.origin.url
2024-12-18T00:04:07.2170106Z Entering 'third_party/protobuf/third_party/googletest'
2024-12-18T00:04:07.2231788Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config	remote.origin.url
2024-12-18T00:04:07.2253007Z Entering 'third_party/psimd'
2024-12-18T00:04:07.2315115Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config	remote.origin.url
2024-12-18T00:04:07.2333637Z Entering 'third_party/pthreadpool'
2024-12-18T00:04:07.2395798Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config	remote.origin.url
2024-12-18T00:04:07.2414725Z Entering 'third_party/pybind11'
2024-12-18T00:04:07.2476341Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config	remote.origin.url
2024-12-18T00:04:07.2496399Z Entering 'third_party/python-peachpy'
2024-12-18T00:04:07.2558671Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config	remote.origin.url
2024-12-18T00:04:07.2578146Z Entering 'third_party/sleef'
2024-12-18T00:04:07.2639956Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config	remote.origin.url
2024-12-18T00:04:07.2661020Z Entering 'third_party/tensorpipe'
2024-12-18T00:04:07.2722682Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config	remote.origin.url
2024-12-18T00:04:07.2741441Z Entering 'third_party/tensorpipe/third_party/googletest'
2024-12-18T00:04:07.2802599Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config	remote.origin.url
2024-12-18T00:04:07.2822210Z Entering 'third_party/tensorpipe/third_party/libnop'
2024-12-18T00:04:07.2884285Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config	remote.origin.url
2024-12-18T00:04:07.2902888Z Entering 'third_party/tensorpipe/third_party/libuv'
2024-12-18T00:04:07.2964901Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config	remote.origin.url
2024-12-18T00:04:07.2983737Z Entering 'third_party/tensorpipe/third_party/pybind11'
2024-12-18T00:04:07.3046063Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config	remote.origin.url
2024-12-18T00:04:07.3065062Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-12-18T00:04:07.3126806Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config	remote.origin.url
2024-12-18T00:04:07.4235473Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:'
2024-12-18T00:04:07.4589917Z Entering 'android/libs/fbjni'
2024-12-18T00:04:07.4639837Z Entering 'third_party/FP16'
2024-12-18T00:04:07.4690463Z Entering 'third_party/FXdiv'
2024-12-18T00:04:07.4739652Z Entering 'third_party/NNPACK'
2024-12-18T00:04:07.4789515Z Entering 'third_party/NVTX'
2024-12-18T00:04:07.4839341Z Entering 'third_party/VulkanMemoryAllocator'
2024-12-18T00:04:07.4889600Z Entering 'third_party/XNNPACK'
2024-12-18T00:04:07.4956625Z Entering 'third_party/benchmark'
2024-12-18T00:04:07.5006610Z Entering 'third_party/composable_kernel'
2024-12-18T00:04:07.5064695Z Entering 'third_party/cpp-httplib'
2024-12-18T00:04:07.5114838Z Entering 'third_party/cpuinfo'
2024-12-18T00:04:07.5165925Z Entering 'third_party/cudnn_frontend'
2024-12-18T00:04:07.5215512Z Entering 'third_party/cutlass'
2024-12-18T00:04:07.5275222Z Entering 'third_party/eigen'
2024-12-18T00:04:07.5327130Z Entering 'third_party/fbgemm'
2024-12-18T00:04:07.5381164Z Entering 'third_party/fbgemm/third_party/asmjit'
2024-12-18T00:04:07.5429778Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2024-12-18T00:04:07.5480373Z Entering 'third_party/fbgemm/third_party/cutlass'
2024-12-18T00:04:07.5537121Z Entering 'third_party/fbgemm/third_party/googletest'
2024-12-18T00:04:07.5588046Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2024-12-18T00:04:07.5638642Z Entering 'third_party/flatbuffers'
2024-12-18T00:04:07.5692063Z Entering 'third_party/fmt'
2024-12-18T00:04:07.5742084Z Entering 'third_party/gemmlowp/gemmlowp'
2024-12-18T00:04:07.5794576Z Entering 'third_party/gloo'
2024-12-18T00:04:07.5843903Z Entering 'third_party/googletest'
2024-12-18T00:04:07.5894117Z Entering 'third_party/ideep'
2024-12-18T00:04:07.5942714Z Entering 'third_party/ideep/mkl-dnn'
2024-12-18T00:04:07.6001067Z Entering 'third_party/ittapi'
2024-12-18T00:04:07.6051127Z Entering 'third_party/kineto'
2024-12-18T00:04:07.6100711Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2024-12-18T00:04:07.6150419Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-12-18T00:04:07.6202904Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-12-18T00:04:07.6252161Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-12-18T00:04:07.6303637Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-12-18T00:04:07.6352437Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-12-18T00:04:07.6405575Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-12-18T00:04:07.6455660Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-12-18T00:04:07.6507383Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-12-18T00:04:07.6558279Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-12-18T00:04:07.6610553Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2024-12-18T00:04:07.6662104Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2024-12-18T00:04:07.6714300Z Entering 'third_party/mimalloc'
2024-12-18T00:04:07.6765277Z Entering 'third_party/nccl/nccl'
2024-12-18T00:04:07.6816179Z Entering 'third_party/nlohmann'
2024-12-18T00:04:07.6868391Z Entering 'third_party/onnx'
2024-12-18T00:04:07.6938662Z Entering 'third_party/onnx/third_party/pybind11'
2024-12-18T00:04:07.6993523Z Entering 'third_party/opentelemetry-cpp'
2024-12-18T00:04:07.7046939Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-12-18T00:04:07.7097641Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2024-12-18T00:04:07.7147628Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-12-18T00:04:07.7196934Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-12-18T00:04:07.7247540Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-12-18T00:04:07.7296758Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-12-18T00:04:07.7345703Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-12-18T00:04:07.7396076Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-12-18T00:04:07.7447748Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-12-18T00:04:07.7499721Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-12-18T00:04:07.7573807Z Entering 'third_party/pocketfft'
2024-12-18T00:04:07.7623090Z Entering 'third_party/protobuf'
2024-12-18T00:04:07.7679063Z Entering 'third_party/protobuf/third_party/benchmark'
2024-12-18T00:04:07.7728645Z Entering 'third_party/protobuf/third_party/googletest'
2024-12-18T00:04:07.7781782Z Entering 'third_party/psimd'
2024-12-18T00:04:07.7832097Z Entering 'third_party/pthreadpool'
2024-12-18T00:04:07.7882983Z Entering 'third_party/pybind11'
2024-12-18T00:04:07.7933374Z Entering 'third_party/python-peachpy'
2024-12-18T00:04:07.7985789Z Entering 'third_party/sleef'
2024-12-18T00:04:07.8036480Z Entering 'third_party/tensorpipe'
2024-12-18T00:04:07.8087855Z Entering 'third_party/tensorpipe/third_party/googletest'
2024-12-18T00:04:07.8138168Z Entering 'third_party/tensorpipe/third_party/libnop'
2024-12-18T00:04:07.8187733Z Entering 'third_party/tensorpipe/third_party/libuv'
2024-12-18T00:04:07.8237868Z Entering 'third_party/tensorpipe/third_party/pybind11'
2024-12-18T00:04:07.8288195Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-12-18T00:04:07.8356733Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:'
2024-12-18T00:04:07.8711362Z Entering 'android/libs/fbjni'
2024-12-18T00:04:07.8761630Z Entering 'third_party/FP16'
2024-12-18T00:04:07.8812207Z Entering 'third_party/FXdiv'
2024-12-18T00:04:07.8863514Z Entering 'third_party/NNPACK'
2024-12-18T00:04:07.8912985Z Entering 'third_party/NVTX'
2024-12-18T00:04:07.8964526Z Entering 'third_party/VulkanMemoryAllocator'
2024-12-18T00:04:07.9013971Z Entering 'third_party/XNNPACK'
2024-12-18T00:04:07.9082930Z Entering 'third_party/benchmark'
2024-12-18T00:04:07.9133192Z Entering 'third_party/composable_kernel'
2024-12-18T00:04:07.9192480Z Entering 'third_party/cpp-httplib'
2024-12-18T00:04:07.9243478Z Entering 'third_party/cpuinfo'
2024-12-18T00:04:07.9295982Z Entering 'third_party/cudnn_frontend'
2024-12-18T00:04:07.9345622Z Entering 'third_party/cutlass'
2024-12-18T00:04:07.9405761Z Entering 'third_party/eigen'
2024-12-18T00:04:07.9458765Z Entering 'third_party/fbgemm'
2024-12-18T00:04:07.9510950Z Entering 'third_party/fbgemm/third_party/asmjit'
2024-12-18T00:04:07.9561954Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2024-12-18T00:04:07.9612300Z Entering 'third_party/fbgemm/third_party/cutlass'
2024-12-18T00:04:07.9671170Z Entering 'third_party/fbgemm/third_party/googletest'
2024-12-18T00:04:07.9721040Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2024-12-18T00:04:07.9773160Z Entering 'third_party/flatbuffers'
2024-12-18T00:04:07.9827396Z Entering 'third_party/fmt'
2024-12-18T00:04:07.9879941Z Entering 'third_party/gemmlowp/gemmlowp'
2024-12-18T00:04:07.9931165Z Entering 'third_party/gloo'
2024-12-18T00:04:07.9982134Z Entering 'third_party/googletest'
2024-12-18T00:04:08.0032334Z Entering 'third_party/ideep'
2024-12-18T00:04:08.0081279Z Entering 'third_party/ideep/mkl-dnn'
2024-12-18T00:04:08.0139431Z Entering 'third_party/ittapi'
2024-12-18T00:04:08.0191793Z Entering 'third_party/kineto'
2024-12-18T00:04:08.0241531Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2024-12-18T00:04:08.0291205Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-12-18T00:04:08.0342999Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-12-18T00:04:08.0392698Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-12-18T00:04:08.0443224Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-12-18T00:04:08.0492384Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-12-18T00:04:08.0543984Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-12-18T00:04:08.0595216Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-12-18T00:04:08.0644966Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-12-18T00:04:08.0696670Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-12-18T00:04:08.0748004Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2024-12-18T00:04:08.0797290Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2024-12-18T00:04:08.0849636Z Entering 'third_party/mimalloc'
2024-12-18T00:04:08.0900195Z Entering 'third_party/nccl/nccl'
2024-12-18T00:04:08.0950818Z Entering 'third_party/nlohmann'
2024-12-18T00:04:08.1002221Z Entering 'third_party/onnx'
2024-12-18T00:04:08.1072311Z Entering 'third_party/onnx/third_party/pybind11'
2024-12-18T00:04:08.1124113Z Entering 'third_party/opentelemetry-cpp'
2024-12-18T00:04:08.1176920Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-12-18T00:04:08.1225655Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2024-12-18T00:04:08.1274603Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-12-18T00:04:08.1322433Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-12-18T00:04:08.1374322Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-12-18T00:04:08.1424927Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-12-18T00:04:08.1473476Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-12-18T00:04:08.1520835Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-12-18T00:04:08.1572100Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-12-18T00:04:08.1622412Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-12-18T00:04:08.1695442Z Entering 'third_party/pocketfft'
2024-12-18T00:04:08.1745332Z Entering 'third_party/protobuf'
2024-12-18T00:04:08.1800991Z Entering 'third_party/protobuf/third_party/benchmark'
2024-12-18T00:04:08.1849419Z Entering 'third_party/protobuf/third_party/googletest'
2024-12-18T00:04:08.1902140Z Entering 'third_party/psimd'
2024-12-18T00:04:08.1952465Z Entering 'third_party/pthreadpool'
2024-12-18T00:04:08.2004015Z Entering 'third_party/pybind11'
2024-12-18T00:04:08.2053780Z Entering 'third_party/python-peachpy'
2024-12-18T00:04:08.2103996Z Entering 'third_party/sleef'
2024-12-18T00:04:08.2153832Z Entering 'third_party/tensorpipe'
2024-12-18T00:04:08.2204728Z Entering 'third_party/tensorpipe/third_party/googletest'
2024-12-18T00:04:08.2253176Z Entering 'third_party/tensorpipe/third_party/libnop'
2024-12-18T00:04:08.2302332Z Entering 'third_party/tensorpipe/third_party/libuv'
2024-12-18T00:04:08.2350796Z Entering 'third_party/tensorpipe/third_party/pybind11'
2024-12-18T00:04:08.2399822Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-12-18T00:04:08.2464930Z ##[endgroup]
2024-12-18T00:04:08.2508853Z [command]/usr/bin/git log -1 --format='%H'
2024-12-18T00:04:08.2531931Z '0cdf8b1d09254cfda66191d1bd01e3041c3c76f7'
2024-12-18T00:04:08.2718735Z Prepare all required actions
2024-12-18T00:04:08.2719474Z Getting action download info
2024-12-18T00:04:08.4529418Z ##[group]Run ./.github/actions/setup-linux
2024-12-18T00:04:08.4529886Z env:
2024-12-18T00:04:08.4530186Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:04:08.4530568Z ##[endgroup]
2024-12-18T00:04:08.4594582Z ##[group]Run set -euo pipefail
2024-12-18T00:04:08.4595221Z set -euo pipefail
2024-12-18T00:04:08.4595807Z function get_ec2_metadata() {
2024-12-18T00:04:08.4596443Z   # Pulled from instance metadata endpoint for EC2
2024-12-18T00:04:08.4597473Z   # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html
2024-12-18T00:04:08.4598322Z   category=$1
2024-12-18T00:04:08.4598912Z   # If it is GCP runner (runner name contains gcp), do not run this
2024-12-18T00:04:08.4599651Z   runner_name_str=i-0988c0a7c81d79530
2024-12-18T00:04:08.4600384Z   if [[ -f /.inarc ]]; then
2024-12-18T00:04:08.4601060Z     echo "ARC Runner, no info on ec2 metadata"
2024-12-18T00:04:08.4601704Z   elif [[ $runner_name_str == *"gcp"* ]]; then
2024-12-18T00:04:08.4602386Z     echo "Runner is from Google Cloud Platform, No info on ec2 metadata"
2024-12-18T00:04:08.4629049Z   else
2024-12-18T00:04:08.4630146Z     curl -H "X-aws-ec2-metadata-token: $(curl -s -X PUT "http://169.254.169.254/latest/api/token" -H "X-aws-ec2-metadata-token-ttl-seconds: 30")" -fsSL "http://169.254.169.254/latest/meta-data/${category}"
2024-12-18T00:04:08.4631294Z   fi
2024-12-18T00:04:08.4631610Z }
2024-12-18T00:04:08.4631982Z echo "ami-id: $(get_ec2_metadata ami-id)"
2024-12-18T00:04:08.4632527Z echo "instance-id: $(get_ec2_metadata instance-id)"
2024-12-18T00:04:08.4633142Z echo "instance-type: $(get_ec2_metadata instance-type)"
2024-12-18T00:04:08.4633688Z echo "system info $(uname -a)"
2024-12-18T00:04:08.4642635Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:04:08.4643132Z env:
2024-12-18T00:04:08.4643438Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:04:08.4643779Z ##[endgroup]
2024-12-18T00:04:08.4809959Z ami-id: ami-0fff1b9a61dec8a5f
2024-12-18T00:04:08.4928634Z instance-id: i-0988c0a7c81d79530
2024-12-18T00:04:08.5048567Z instance-type: g3.4xlarge
2024-12-18T00:04:08.5061767Z system info Linux ip-10-1-51-133.ec2.internal 6.1.109-118.189.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Sep 10 08:59:12 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
2024-12-18T00:04:08.5095652Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2024-12-18T00:04:08.5096921Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2024-12-18T00:04:08.5104441Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:04:08.5104985Z env:
2024-12-18T00:04:08.5105280Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:04:08.5105658Z ##[endgroup]
2024-12-18T00:04:08.5177491Z ##[group]Run if systemctl is-active --quiet docker; then
2024-12-18T00:04:08.5178127Z if systemctl is-active --quiet docker; then
2024-12-18T00:04:08.5178675Z     echo "Docker daemon is running...";
2024-12-18T00:04:08.5179116Z else
2024-12-18T00:04:08.5179621Z     echo "Starting docker deamon..." && sudo systemctl start docker;
2024-12-18T00:04:08.5180446Z fi
2024-12-18T00:04:08.5187129Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:04:08.5187655Z env:
2024-12-18T00:04:08.5187961Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:04:08.5188322Z ##[endgroup]
2024-12-18T00:04:08.5273593Z Docker daemon is running...
2024-12-18T00:04:08.5328657Z ##[group]Run nick-fields/retry@v3.0.0
2024-12-18T00:04:08.5329100Z with:
2024-12-18T00:04:08.5329397Z   shell: bash
2024-12-18T00:04:08.5329932Z   timeout_minutes: 5
2024-12-18T00:04:08.5330324Z   max_attempts: 3
2024-12-18T00:04:08.5330671Z   retry_wait_seconds: 30
2024-12-18T00:04:08.5333658Z   command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\")
aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \
    --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com"

# For LF Runners we need to make sure we also login to Meta's ECR docker registry too.
META_AWS_ACCOUNT_ID=308535385114
if [ "$AWS_ACCOUNT_ID" != "$META_AWS_ACCOUNT_ID" ] ; then
    aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \
        --password-stdin "$META_AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com"
fi

2024-12-18T00:04:08.5336714Z   polling_interval_seconds: 1
2024-12-18T00:04:08.5337123Z   warning_on_retry: true
2024-12-18T00:04:08.5337507Z   continue_on_error: false
2024-12-18T00:04:08.5337878Z env:
2024-12-18T00:04:08.5338189Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:04:08.5338559Z   AWS_RETRY_MODE: standard
2024-12-18T00:04:08.5338947Z   AWS_MAX_ATTEMPTS: 5
2024-12-18T00:04:08.5339322Z   AWS_DEFAULT_REGION: us-east-1
2024-12-18T00:04:08.5339721Z ##[endgroup]
2024-12-18T00:04:10.0655789Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json.
2024-12-18T00:04:10.0656810Z Configure a credential helper to remove this warning. See
2024-12-18T00:04:10.0657546Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store
2024-12-18T00:04:10.0658071Z 
2024-12-18T00:04:10.0658744Z Login Succeeded
2024-12-18T00:04:10.7857403Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json.
2024-12-18T00:04:10.7858202Z Configure a credential helper to remove this warning. See
2024-12-18T00:04:10.7858935Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store
2024-12-18T00:04:10.7859440Z 
2024-12-18T00:04:10.7859588Z Login Succeeded
2024-12-18T00:04:11.6471439Z Command completed after 1 attempt(s).
2024-12-18T00:04:11.6545613Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}"
2024-12-18T00:04:11.6546290Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}"
2024-12-18T00:04:11.6546885Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}"
2024-12-18T00:04:11.6554630Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:04:11.6555129Z env:
2024-12-18T00:04:11.6555437Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:04:11.6555796Z ##[endgroup]
2024-12-18T00:04:11.6660933Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty
2024-12-18T00:04:11.6661660Z # ignore expansion of "docker ps -q" since it could be empty
2024-12-18T00:04:11.6662211Z # shellcheck disable=SC2046
2024-12-18T00:04:11.6662643Z docker stop $(docker ps -q) || true
2024-12-18T00:04:11.6663102Z # Prune all of the docker images
2024-12-18T00:04:11.6663551Z docker system prune -af
2024-12-18T00:04:11.6670108Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:04:11.6670611Z env:
2024-12-18T00:04:11.6670917Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:04:11.6671263Z ##[endgroup]
2024-12-18T00:04:11.7015032Z "docker stop" requires at least 1 argument.
2024-12-18T00:04:11.7015875Z See 'docker stop --help'.
2024-12-18T00:04:11.7016152Z 
2024-12-18T00:04:11.7016553Z Usage:  docker stop [OPTIONS] CONTAINER [CONTAINER...]
2024-12-18T00:04:11.7017350Z 
2024-12-18T00:04:11.7017684Z Stop one or more running containers
2024-12-18T00:04:11.7387397Z Deleted Images:
2024-12-18T00:04:11.7388007Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine:latest
2024-12-18T00:04:11.7389432Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine@sha256:def822f9851ca422481ec6fee59a9966f12b351c62ccb9aca841526ffaa9f748
2024-12-18T00:04:11.7390533Z deleted: sha256:6dbb9cc54074106d46d4ccb330f2a40a682d49dda5f4844962b7dce9fe44aaec
2024-12-18T00:04:11.7391656Z deleted: sha256:b2d5eeeaba3a22b9b8aa97261957974a6bd65274ebd43e1d81d0a7b8b752b116
2024-12-18T00:04:11.7392191Z 
2024-12-18T00:04:11.7406053Z Total reclaimed space: 5.613MB
2024-12-18T00:04:11.7450988Z ##[group]Run set +e
2024-12-18T00:04:11.7451425Z set +e
2024-12-18T00:04:11.7451730Z set -x
2024-12-18T00:04:11.7452045Z 
2024-12-18T00:04:11.7452377Z PT_DOMAIN=download.pytorch.org
2024-12-18T00:04:11.7453109Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400,
2024-12-18T00:04:11.7454064Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last
2024-12-18T00:04:11.7454722Z # one is returned at random
2024-12-18T00:04:11.7455217Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1)
2024-12-18T00:04:11.7455707Z 
2024-12-18T00:04:11.7456501Z if [ -z "${RESOLVED_IP}" ]; then
2024-12-18T00:04:11.7457094Z   echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..."
2024-12-18T00:04:11.7457767Z   RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1)
2024-12-18T00:04:11.7458277Z 
2024-12-18T00:04:11.7458587Z   if [ -z "${RESOLVED_IP}" ]; then
2024-12-18T00:04:11.7459097Z     echo "Couldn't resolve ${PT_DOMAIN}, exiting..."
2024-12-18T00:04:11.7459572Z     exit 1
2024-12-18T00:04:11.7459899Z   fi
2024-12-18T00:04:11.7460200Z fi
2024-12-18T00:04:11.7460474Z 
2024-12-18T00:04:11.7460838Z if grep -r "${PT_DOMAIN}" /etc/hosts; then
2024-12-18T00:04:11.7461325Z   # Clean up any old records first
2024-12-18T00:04:11.7461798Z   sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts
2024-12-18T00:04:11.7462237Z fi
2024-12-18T00:04:11.7462503Z 
2024-12-18T00:04:11.7462916Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts
2024-12-18T00:04:11.7463434Z cat /etc/hosts
2024-12-18T00:04:11.7470747Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:04:11.7471245Z env:
2024-12-18T00:04:11.7471534Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:04:11.7471896Z ##[endgroup]
2024-12-18T00:04:11.7501131Z + PT_DOMAIN=download.pytorch.org
2024-12-18T00:04:11.7507660Z ++ dig -4 +short download.pytorch.org
2024-12-18T00:04:11.7509068Z ++ tail -n1
2024-12-18T00:04:11.7646417Z + RESOLVED_IP=108.138.64.97
2024-12-18T00:04:11.7646827Z + '[' -z 108.138.64.97 ']'
2024-12-18T00:04:11.7647227Z + grep -r download.pytorch.org /etc/hosts
2024-12-18T00:04:11.7661509Z 3.167.99.125 download.pytorch.org
2024-12-18T00:04:11.7663249Z + sudo sed -i /download.pytorch.org/d /etc/hosts
2024-12-18T00:04:11.8968030Z + echo '108.138.64.97 download.pytorch.org'
2024-12-18T00:04:11.8968803Z + sudo tee -a /etc/hosts
2024-12-18T00:04:11.9525546Z 108.138.64.97 download.pytorch.org
2024-12-18T00:04:11.9545970Z + cat /etc/hosts
2024-12-18T00:04:11.9557807Z 127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
2024-12-18T00:04:11.9564879Z ::1         localhost6 localhost6.localdomain6
2024-12-18T00:04:11.9565375Z 108.138.64.97 download.pytorch.org
2024-12-18T00:04:11.9768783Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@release/2.6
2024-12-18T00:04:11.9769497Z with:
2024-12-18T00:04:11.9770469Z   docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda11.8-cudnn9-py3-gcc9:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:04:11.9771576Z   docker-build-dir: .ci/docker
2024-12-18T00:04:11.9772226Z   working-directory: .
2024-12-18T00:04:11.9772736Z   docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-12-18T00:04:11.9773281Z   force-push: false
2024-12-18T00:04:11.9773623Z env:
2024-12-18T00:04:11.9773935Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:04:11.9774318Z ##[endgroup]
2024-12-18T00:04:11.9809261Z ##[group]Run set -ex
2024-12-18T00:04:11.9809686Z set -ex
2024-12-18T00:04:11.9809989Z 
2024-12-18T00:04:11.9810505Z # If the docker build directory or the build script doesn't exist, the action will
2024-12-18T00:04:11.9811398Z # gracefully return the docker image name as it is.  Pulling docker image in Linux
2024-12-18T00:04:11.9812121Z # job could then download the pre-built image as usual
2024-12-18T00:04:11.9812756Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then
2024-12-18T00:04:11.9813360Z   echo "skip=true" >> "${GITHUB_OUTPUT}"
2024-12-18T00:04:11.9813943Z   echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}"
2024-12-18T00:04:11.9814464Z 
2024-12-18T00:04:11.9814929Z   echo "There is no Docker build script in ${REPO_NAME} repo, skipping..."
2024-12-18T00:04:11.9815489Z   exit 0
2024-12-18T00:04:11.9815786Z else
2024-12-18T00:04:11.9816148Z   echo "skip=false" >> "${GITHUB_OUTPUT}"
2024-12-18T00:04:11.9816578Z fi
2024-12-18T00:04:11.9816871Z 
2024-12-18T00:04:11.9817319Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then
2024-12-18T00:04:11.9818057Z   # The docker image name already includes the ECR prefix and tag, so we can just
2024-12-18T00:04:11.9818736Z   # use it as it is, but first let's extract the tag
2024-12-18T00:04:11.9819348Z   DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}')
2024-12-18T00:04:11.9819997Z   echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}"
2024-12-18T00:04:11.9820638Z   echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}"
2024-12-18T00:04:11.9821168Z else
2024-12-18T00:04:11.9821575Z   DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}")
2024-12-18T00:04:11.9822162Z   echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}"
2024-12-18T00:04:11.9822967Z   echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}"
2024-12-18T00:04:11.9823672Z fi
2024-12-18T00:04:11.9831710Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:04:11.9832206Z env:
2024-12-18T00:04:11.9832509Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:04:11.9832874Z   REPO_NAME: pytorch
2024-12-18T00:04:11.9833802Z   DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda11.8-cudnn9-py3-gcc9:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:04:11.9834803Z   DOCKER_BUILD_DIR: .ci/docker
2024-12-18T00:04:11.9835298Z   DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-12-18T00:04:11.9835806Z ##[endgroup]
2024-12-18T00:04:11.9866262Z + [[ ! -d .ci/docker ]]
2024-12-18T00:04:11.9866638Z + [[ ! -f .ci/docker/build.sh ]]
2024-12-18T00:04:11.9867028Z + echo skip=false
2024-12-18T00:04:11.9868483Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda11.8-cudnn9-py3-gcc9:45e1356b47a284893081276eff3000b7b534f3b1 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]]
2024-12-18T00:04:11.9875419Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda11.8-cudnn9-py3-gcc9:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:04:11.9876417Z ++ awk -F '[:,]' '{print $2}'
2024-12-18T00:04:11.9900937Z + DOCKER_TAG=45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:04:11.9901511Z + echo docker-tag=45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:04:11.9902758Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda11.8-cudnn9-py3-gcc9:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:04:11.9940130Z ##[group]Run set +e
2024-12-18T00:04:11.9940587Z set +e
2024-12-18T00:04:11.9940922Z set -x
2024-12-18T00:04:11.9941249Z 
2024-12-18T00:04:11.9941532Z login() {
2024-12-18T00:04:11.9942199Z   aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1"
2024-12-18T00:04:11.9942923Z }
2024-12-18T00:04:11.9943227Z 
2024-12-18T00:04:11.9943539Z retry () {
2024-12-18T00:04:11.9943917Z   $*  || (sleep 1 && $*) || (sleep 2 && $*)
2024-12-18T00:04:11.9944364Z }
2024-12-18T00:04:11.9944668Z 
2024-12-18T00:04:11.9945006Z retry login "${DOCKER_REGISTRY}"
2024-12-18T00:04:11.9945501Z 
2024-12-18T00:04:11.9945807Z START_TIME=$(date +%s)
2024-12-18T00:04:11.9946225Z # Wait up to 90 minutes
2024-12-18T00:04:11.9946707Z while [[ $(( $(date +%s) - 5400 )) -lt $START_TIME ]]; do
2024-12-18T00:04:11.9947344Z   # Check if image already exists, if it does then skip building it
2024-12-18T00:04:11.9947975Z   if docker manifest inspect "${DOCKER_IMAGE}"; then
2024-12-18T00:04:11.9948482Z     exit 0
2024-12-18T00:04:11.9948813Z   fi
2024-12-18T00:04:11.9949116Z 
2024-12-18T00:04:11.9949596Z   # NB: This flag is used by Docker build workflow to push the image to ECR, so we can
2024-12-18T00:04:11.9950431Z   # use this to differentiate between the Docker build and regular build jobs. For the
2024-12-18T00:04:11.9951259Z   # latter, it will wait for the Docker images to become available before continuing
2024-12-18T00:04:11.9951918Z   if [ "${DOCKER_PUSH:-false}" == "true" ]; then
2024-12-18T00:04:11.9952451Z     # It's a Docker build job, let's build the image
2024-12-18T00:04:11.9952921Z     break
2024-12-18T00:04:11.9953231Z   else
2024-12-18T00:04:11.9953687Z     # It's a regular build job, wait for the image to become available
2024-12-18T00:04:11.9954224Z     sleep 300
2024-12-18T00:04:11.9954568Z   fi
2024-12-18T00:04:11.9954876Z done
2024-12-18T00:04:11.9955162Z 
2024-12-18T00:04:11.9955639Z # NB: This part requires a full checkout. Otherwise, the merge base will
2024-12-18T00:04:11.9956882Z # be empty.  The default action would be to continue rebuild the image
2024-12-18T00:04:11.9957545Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then
2024-12-18T00:04:11.9958130Z   # if we're on the base branch then use the parent commit
2024-12-18T00:04:11.9958658Z   MERGE_BASE=$(git rev-parse HEAD~)
2024-12-18T00:04:11.9959079Z else
2024-12-18T00:04:11.9959504Z   # otherwise we're on a PR, so use the most recent base commit
2024-12-18T00:04:11.9960128Z   MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION")
2024-12-18T00:04:11.9960602Z fi
2024-12-18T00:04:11.9960903Z 
2024-12-18T00:04:11.9961228Z if [[ -z "${MERGE_BASE}" ]]; then
2024-12-18T00:04:11.9961687Z   echo "rebuild=true" >> "${GITHUB_OUTPUT}"
2024-12-18T00:04:11.9962129Z 
2024-12-18T00:04:11.9962722Z   echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..."
2024-12-18T00:04:11.9963411Z   exit 0
2024-12-18T00:04:11.9963935Z fi
2024-12-18T00:04:11.9964265Z 
2024-12-18T00:04:11.9964662Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then
2024-12-18T00:04:11.9965513Z   echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit"
2024-12-18T00:04:11.9966245Z   exit 1
2024-12-18T00:04:11.9966691Z fi
2024-12-18T00:04:11.9966990Z 
2024-12-18T00:04:11.9967453Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}")
2024-12-18T00:04:11.9968264Z # If no image exists but the hash is the same as the previous hash then we should error out here
2024-12-18T00:04:11.9969005Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then
2024-12-18T00:04:11.9969837Z   echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch"
2024-12-18T00:04:11.9970785Z   echo "         Will re-build docker image to store in local cache, TTS may be longer"
2024-12-18T00:04:11.9971366Z fi
2024-12-18T00:04:11.9971661Z 
2024-12-18T00:04:11.9971993Z echo "rebuild=true" >> "${GITHUB_OUTPUT}"
2024-12-18T00:04:11.9978700Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:04:11.9979191Z env:
2024-12-18T00:04:11.9979506Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:04:11.9979880Z   DOCKER_BUILD_DIR: .ci/docker
2024-12-18T00:04:11.9980321Z   BASE_REVISION: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:04:11.9981363Z   DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda11.8-cudnn9-py3-gcc9:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:04:11.9982377Z   DOCKER_TAG: 45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:04:11.9982941Z   DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-12-18T00:04:11.9983444Z   DOCKER_PUSH: 
2024-12-18T00:04:11.9983759Z ##[endgroup]
2024-12-18T00:04:12.0012335Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-12-18T00:04:12.0012934Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-12-18T00:04:12.0015836Z + aws ecr get-login-password --region us-east-1
2024-12-18T00:04:12.0017093Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-12-18T00:04:12.7143282Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json.
2024-12-18T00:04:12.7144102Z Configure a credential helper to remove this warning. See
2024-12-18T00:04:12.7144833Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store
2024-12-18T00:04:12.7145334Z 
2024-12-18T00:04:12.7146960Z Login Succeeded
2024-12-18T00:04:12.7162900Z ++ date +%s
2024-12-18T00:04:12.7174389Z + START_TIME=1734480252
2024-12-18T00:04:12.7178487Z ++ date +%s
2024-12-18T00:04:12.7188671Z + [[ 1734474852 -lt 1734480252 ]]
2024-12-18T00:04:12.7189761Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda11.8-cudnn9-py3-gcc9:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:04:12.9511271Z {
2024-12-18T00:04:12.9511840Z 	"schemaVersion": 2,
2024-12-18T00:04:12.9512459Z 	"mediaType": "application/vnd.docker.distribution.manifest.v2+json",
2024-12-18T00:04:12.9513051Z 	"config": {
2024-12-18T00:04:12.9513505Z 		"mediaType": "application/vnd.docker.container.image.v1+json",
2024-12-18T00:04:12.9514060Z 		"size": 50450,
2024-12-18T00:04:12.9514606Z 		"digest": "sha256:166dd14a00627fbd0d4e062a733b69b733b63b1ac12ec3bd5285db8a8befaaf5"
2024-12-18T00:04:12.9515192Z 	},
2024-12-18T00:04:12.9515481Z 	"layers": [
2024-12-18T00:04:12.9515778Z 		{
2024-12-18T00:04:12.9516221Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9516769Z 			"size": 28580681,
2024-12-18T00:04:12.9517308Z 			"digest": "sha256:7a2c559011895d255fce249c00396abff5ae7e0c0a92931d0ed493e71de78e3a"
2024-12-18T00:04:12.9517923Z 		},
2024-12-18T00:04:12.9518220Z 		{
2024-12-18T00:04:12.9519011Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9519630Z 			"size": 7943353,
2024-12-18T00:04:12.9520194Z 			"digest": "sha256:09d415c238d76b32a7ea4a6e6add9542db9a5641f7f183af70aae185d0709e58"
2024-12-18T00:04:12.9521011Z 		},
2024-12-18T00:04:12.9521413Z 		{
2024-12-18T00:04:12.9521877Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9522668Z 			"size": 56226389,
2024-12-18T00:04:12.9523238Z 			"digest": "sha256:9fe6e2e61518cba6844870c03b285737daec35e62baf25ae7744629ed3a7b470"
2024-12-18T00:04:12.9523883Z 		},
2024-12-18T00:04:12.9524167Z 		{
2024-12-18T00:04:12.9524628Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9525209Z 			"size": 187,
2024-12-18T00:04:12.9525758Z 			"digest": "sha256:41f16248e682693ff20b3032c1d5e5541cc87c5af898ae2ff9b24d2940e59100"
2024-12-18T00:04:12.9526463Z 		},
2024-12-18T00:04:12.9527049Z 		{
2024-12-18T00:04:12.9527662Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9528363Z 			"size": 6885,
2024-12-18T00:04:12.9529160Z 			"digest": "sha256:95d7b781703928cf3c4eece39d800cccb76728c375fedf51ecd83833fb25e458"
2024-12-18T00:04:12.9529927Z 		},
2024-12-18T00:04:12.9530345Z 		{
2024-12-18T00:04:12.9555717Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9557066Z 			"size": 1383662475,
2024-12-18T00:04:12.9557915Z 			"digest": "sha256:8f6c9048534734f4c873935293b7296225846ceb31c1a158400a67ea170dde7f"
2024-12-18T00:04:12.9558520Z 		},
2024-12-18T00:04:12.9558796Z 		{
2024-12-18T00:04:12.9559239Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9559785Z 			"size": 62282,
2024-12-18T00:04:12.9560298Z 			"digest": "sha256:ab17245097e491b9368790714f9d90ed447bf0973bd677cfe6f2456d62b72a13"
2024-12-18T00:04:12.9560891Z 		},
2024-12-18T00:04:12.9561172Z 		{
2024-12-18T00:04:12.9561643Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9562244Z 			"size": 1684,
2024-12-18T00:04:12.9562806Z 			"digest": "sha256:dfecd7e9912b76ed460b8edd5a85f1943666e38a973ab5458177cf2c7c3110e3"
2024-12-18T00:04:12.9563462Z 		},
2024-12-18T00:04:12.9563740Z 		{
2024-12-18T00:04:12.9564200Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9564782Z 			"size": 1522,
2024-12-18T00:04:12.9565351Z 			"digest": "sha256:464a8f74544589bf7b57f9a4cadcb6681e5ed00758f6c35025e691df4e88e890"
2024-12-18T00:04:12.9565999Z 		},
2024-12-18T00:04:12.9566279Z 		{
2024-12-18T00:04:12.9566743Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9567322Z 			"size": 2445884909,
2024-12-18T00:04:12.9567885Z 			"digest": "sha256:d67c111fa58886d8904335b5122039816c8e51af5844cb6fe4e14154d9a7c016"
2024-12-18T00:04:12.9568512Z 		},
2024-12-18T00:04:12.9568787Z 		{
2024-12-18T00:04:12.9569241Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9569822Z 			"size": 85882,
2024-12-18T00:04:12.9570370Z 			"digest": "sha256:0723abde19c09431db80b5d0f0e003541f6232c2da5c4f35c635c861875937ae"
2024-12-18T00:04:12.9571011Z 		},
2024-12-18T00:04:12.9571289Z 		{
2024-12-18T00:04:12.9571743Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9572324Z 			"size": 1825,
2024-12-18T00:04:12.9572885Z 			"digest": "sha256:38b3bd834f10691245159178ede4a97949d80aafef88c4da88bc8c59b128c195"
2024-12-18T00:04:12.9573534Z 		},
2024-12-18T00:04:12.9573811Z 		{
2024-12-18T00:04:12.9574360Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9574917Z 			"size": 655189618,
2024-12-18T00:04:12.9575455Z 			"digest": "sha256:e45523662aa5eb3b174fdd800641a054a960911c585cea9b0782baf969a4dfa5"
2024-12-18T00:04:12.9576097Z 		},
2024-12-18T00:04:12.9576378Z 		{
2024-12-18T00:04:12.9576839Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9577425Z 			"size": 704,
2024-12-18T00:04:12.9578194Z 			"digest": "sha256:5a6d97ee6e47c9a76f0de956b2f0e28bfc3947fdf421470b6202b5ba2702f3a9"
2024-12-18T00:04:12.9578892Z 		},
2024-12-18T00:04:12.9579174Z 		{
2024-12-18T00:04:12.9579640Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9580223Z 			"size": 1260,
2024-12-18T00:04:12.9580790Z 			"digest": "sha256:8b9cee92f4081f7ae7b4ac3842ed028a3595044d35c3aabdfdf61fdf414b422c"
2024-12-18T00:04:12.9581612Z 		},
2024-12-18T00:04:12.9581894Z 		{
2024-12-18T00:04:12.9582356Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9582940Z 			"size": 484,
2024-12-18T00:04:12.9583489Z 			"digest": "sha256:05a25e0e092fec6d2dd4a72016ea313485058594415703c2be2cc9fb041d483b"
2024-12-18T00:04:12.9584129Z 		},
2024-12-18T00:04:12.9584410Z 		{
2024-12-18T00:04:12.9584867Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9585452Z 			"size": 91714827,
2024-12-18T00:04:12.9586022Z 			"digest": "sha256:32f9bd3454b2990eb47fa1b21e333f7e8b560c5c086f531c5ee9389676c218ac"
2024-12-18T00:04:12.9586675Z 		},
2024-12-18T00:04:12.9586958Z 		{
2024-12-18T00:04:12.9587415Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9587989Z 			"size": 3707,
2024-12-18T00:04:12.9588560Z 			"digest": "sha256:7cef0be11b192948fbbde9ab3ef1a6d84a3008372f6c8dd6b2bc29b049f76e74"
2024-12-18T00:04:12.9589221Z 		},
2024-12-18T00:04:12.9589499Z 		{
2024-12-18T00:04:12.9589956Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9590535Z 			"size": 1860,
2024-12-18T00:04:12.9591091Z 			"digest": "sha256:3a7f27881c57c1035aa6d2109802ac6da11afd93eaa81d48ba8e07f910242248"
2024-12-18T00:04:12.9591734Z 		},
2024-12-18T00:04:12.9592015Z 		{
2024-12-18T00:04:12.9592474Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9593057Z 			"size": 700,
2024-12-18T00:04:12.9593618Z 			"digest": "sha256:7feada69620ed9505fc525cf4e6d81f7d25589cb3c26fe8fef7479807372f91a"
2024-12-18T00:04:12.9594276Z 		},
2024-12-18T00:04:12.9594552Z 		{
2024-12-18T00:04:12.9595007Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9595568Z 			"size": 478,
2024-12-18T00:04:12.9596143Z 			"digest": "sha256:1f019fb4d944db0c3f6f320a880353d7ebeae6df3456f7e492b7a6c19e7430f2"
2024-12-18T00:04:12.9596801Z 		},
2024-12-18T00:04:12.9597087Z 		{
2024-12-18T00:04:12.9597545Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9598109Z 			"size": 2953611806,
2024-12-18T00:04:12.9598699Z 			"digest": "sha256:f900f32845825b74c796aa12c8ca7412b38ae05813a53257f53b49bb2b501bcd"
2024-12-18T00:04:12.9599341Z 		},
2024-12-18T00:04:12.9599620Z 		{
2024-12-18T00:04:12.9600078Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9600635Z 			"size": 380,
2024-12-18T00:04:12.9601213Z 			"digest": "sha256:03ef53c6b863b93f161c2bf5eb906c9cae887d4e3cb793fa06212162c09b3584"
2024-12-18T00:04:12.9601870Z 		},
2024-12-18T00:04:12.9602154Z 		{
2024-12-18T00:04:12.9602619Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9603185Z 			"size": 12909,
2024-12-18T00:04:12.9603772Z 			"digest": "sha256:8c33d01f9e39d69c625c8a507af96fef2fa8f95ff019b7e060062fbd98da0a3b"
2024-12-18T00:04:12.9604424Z 		},
2024-12-18T00:04:12.9604704Z 		{
2024-12-18T00:04:12.9605172Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9605741Z 			"size": 863,
2024-12-18T00:04:12.9606305Z 			"digest": "sha256:49be5867b6ab28064a789b446635d6ec60a1c639deffec9c581499d09a20d31a"
2024-12-18T00:04:12.9606943Z 		},
2024-12-18T00:04:12.9607222Z 		{
2024-12-18T00:04:12.9607680Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9608243Z 			"size": 106,
2024-12-18T00:04:12.9608818Z 			"digest": "sha256:2c921c2b926223806ddf443e5a591ae34c19c50f553adea16a2ae986a821b47e"
2024-12-18T00:04:12.9609467Z 		},
2024-12-18T00:04:12.9609845Z 		{
2024-12-18T00:04:12.9610326Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9610883Z 			"size": 504,
2024-12-18T00:04:12.9611449Z 			"digest": "sha256:f276569c48f345d048de43d8296869ea278af215142ba5741b765adeac6c238f"
2024-12-18T00:04:12.9612086Z 		},
2024-12-18T00:04:12.9612368Z 		{
2024-12-18T00:04:12.9612833Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9613513Z 			"size": 121477378,
2024-12-18T00:04:12.9614112Z 			"digest": "sha256:cac6488770e66c796a9bae0e25b007efd1ff47a360bc5714b7fd2946a39ff59b"
2024-12-18T00:04:12.9614764Z 		},
2024-12-18T00:04:12.9615041Z 		{
2024-12-18T00:04:12.9615499Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9616063Z 			"size": 109,
2024-12-18T00:04:12.9616624Z 			"digest": "sha256:9695d05a4951d9c024dd2d0726270c2acd5c81cbb1986ae03f60e167357f43cf"
2024-12-18T00:04:12.9617263Z 		},
2024-12-18T00:04:12.9617542Z 		{
2024-12-18T00:04:12.9618006Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9618571Z 			"size": 489,
2024-12-18T00:04:12.9619141Z 			"digest": "sha256:2857ab4d43aab8ad9d8ba6af295f20bfb83a30f5442e8502e1db44c385916241"
2024-12-18T00:04:12.9619795Z 		},
2024-12-18T00:04:12.9620074Z 		{
2024-12-18T00:04:12.9620534Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9621108Z 			"size": 296,
2024-12-18T00:04:12.9621685Z 			"digest": "sha256:fcdec1f5e2fde1f1945361f0d3c56b33a33f65d42378ff4ca797060040518bf0"
2024-12-18T00:04:12.9622340Z 		},
2024-12-18T00:04:12.9622618Z 		{
2024-12-18T00:04:12.9623075Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9623632Z 			"size": 103,
2024-12-18T00:04:12.9624221Z 			"digest": "sha256:ff1478fbefd979ac80d1b176b2c3f6ddcf4cecf685433398b03bc4f0cbd06110"
2024-12-18T00:04:12.9624891Z 		},
2024-12-18T00:04:12.9625167Z 		{
2024-12-18T00:04:12.9625639Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9626210Z 			"size": 1476,
2024-12-18T00:04:12.9626811Z 			"digest": "sha256:f8a6d90f0b3ef982ba39428cb0d40dc4c9e03df7c4011258916d4d5dab1bef27"
2024-12-18T00:04:12.9627465Z 		},
2024-12-18T00:04:12.9627727Z 		{
2024-12-18T00:04:12.9628189Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9628774Z 			"size": 430258066,
2024-12-18T00:04:12.9629358Z 			"digest": "sha256:011542937262656639e466e38068de398e4565825a5b1d02acc425bd4da3ed3d"
2024-12-18T00:04:12.9629986Z 		},
2024-12-18T00:04:12.9630248Z 		{
2024-12-18T00:04:12.9630710Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9631299Z 			"size": 162,
2024-12-18T00:04:12.9631880Z 			"digest": "sha256:812caf3e433816d6c7bea249be5ff35aa976d1d044d32c02741ac161aade0327"
2024-12-18T00:04:12.9632541Z 		},
2024-12-18T00:04:12.9632804Z 		{
2024-12-18T00:04:12.9633269Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9633860Z 			"size": 564,
2024-12-18T00:04:12.9634428Z 			"digest": "sha256:7e2aa240b70cc8e1f87f625b28c79751d71f025760c2402d0c695d6333847c71"
2024-12-18T00:04:12.9635070Z 		},
2024-12-18T00:04:12.9635336Z 		{
2024-12-18T00:04:12.9635797Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9636382Z 			"size": 35806330,
2024-12-18T00:04:12.9636976Z 			"digest": "sha256:a0e5fd2630de64c400e6cc5c43094e8ac4550325904f24db8f710842f33cc348"
2024-12-18T00:04:12.9637631Z 		},
2024-12-18T00:04:12.9637895Z 		{
2024-12-18T00:04:12.9638358Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9638929Z 			"size": 104,
2024-12-18T00:04:12.9639495Z 			"digest": "sha256:a7253f4f13102b2c05f098066e2c11157d6b24c4cb879b3f3f9a5e29e73aa482"
2024-12-18T00:04:12.9640130Z 		},
2024-12-18T00:04:12.9640386Z 		{
2024-12-18T00:04:12.9640844Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9641424Z 			"size": 425,
2024-12-18T00:04:12.9642087Z 			"digest": "sha256:d4bbe33feb5a0018de6d8445ad79aa990043b624c90752a4f264235b00ce9c71"
2024-12-18T00:04:12.9642756Z 		},
2024-12-18T00:04:12.9643015Z 		{
2024-12-18T00:04:12.9643484Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9644070Z 			"size": 20262180,
2024-12-18T00:04:12.9644679Z 			"digest": "sha256:c7da3e1fda207aae43390fd25dc953ee6bb0fb29d6f92fe8ea45e25af003040e"
2024-12-18T00:04:12.9645444Z 		},
2024-12-18T00:04:12.9645763Z 		{
2024-12-18T00:04:12.9646214Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9646763Z 			"size": 643,
2024-12-18T00:04:12.9647283Z 			"digest": "sha256:a1fa96c8688be0cd5c869e56cb39672774ca1466e3b55b296c07e6ddafc196db"
2024-12-18T00:04:12.9647916Z 		},
2024-12-18T00:04:12.9648192Z 		{
2024-12-18T00:04:12.9648649Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9649230Z 			"size": 700,
2024-12-18T00:04:12.9649821Z 			"digest": "sha256:7feada69620ed9505fc525cf4e6d81f7d25589cb3c26fe8fef7479807372f91a"
2024-12-18T00:04:12.9650463Z 		},
2024-12-18T00:04:12.9650740Z 		{
2024-12-18T00:04:12.9651208Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9651792Z 			"size": 141,
2024-12-18T00:04:12.9652370Z 			"digest": "sha256:600e7beb6ed65b70903fb3d10a7720f76a0e7ed4225e6a2d974edab4ded9985c"
2024-12-18T00:04:12.9653010Z 		},
2024-12-18T00:04:12.9653292Z 		{
2024-12-18T00:04:12.9653757Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9654337Z 			"size": 136,
2024-12-18T00:04:12.9654915Z 			"digest": "sha256:7fee2a426d6e9e46b8fa661021c0cb6cbe7f52186061b61d7f32df2ec7f1dbae"
2024-12-18T00:04:12.9655556Z 		},
2024-12-18T00:04:12.9655838Z 		{
2024-12-18T00:04:12.9656774Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9657326Z 			"size": 32,
2024-12-18T00:04:12.9657880Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-12-18T00:04:12.9658474Z 		},
2024-12-18T00:04:12.9658752Z 		{
2024-12-18T00:04:12.9659193Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9659735Z 			"size": 196,
2024-12-18T00:04:12.9660262Z 			"digest": "sha256:321081f536b035434bb8104a9d93a930eba4415dbeffb4ce926a7c9560a818a9"
2024-12-18T00:04:12.9660839Z 		},
2024-12-18T00:04:12.9661125Z 		{
2024-12-18T00:04:12.9661564Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9662104Z 			"size": 565,
2024-12-18T00:04:12.9662621Z 			"digest": "sha256:b2671014f386836740538595eb3d3d98580b1d88d3d63ade2ac59313e53526bd"
2024-12-18T00:04:12.9663182Z 		},
2024-12-18T00:04:12.9663452Z 		{
2024-12-18T00:04:12.9663887Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9664424Z 			"size": 43163802,
2024-12-18T00:04:12.9664956Z 			"digest": "sha256:94a3028693ada8037297f5512a3a90c4d307bf06337ef43fcbce578505dbb02d"
2024-12-18T00:04:12.9665584Z 		},
2024-12-18T00:04:12.9665873Z 		{
2024-12-18T00:04:12.9666346Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9666932Z 			"size": 106,
2024-12-18T00:04:12.9667501Z 			"digest": "sha256:838f3043a48a3fccad46b59399809bd6a67048404a30c44f8d04272c826634c4"
2024-12-18T00:04:12.9668127Z 		},
2024-12-18T00:04:12.9668408Z 		{
2024-12-18T00:04:12.9668878Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9669473Z 			"size": 1402,
2024-12-18T00:04:12.9670018Z 			"digest": "sha256:3bf4f9678a1173c728cf0aa3632bbc5de29b674a2c547de331ecd9d3dd86e8c4"
2024-12-18T00:04:12.9670612Z 		},
2024-12-18T00:04:12.9670888Z 		{
2024-12-18T00:04:12.9671348Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9671932Z 			"size": 700,
2024-12-18T00:04:12.9672504Z 			"digest": "sha256:7feada69620ed9505fc525cf4e6d81f7d25589cb3c26fe8fef7479807372f91a"
2024-12-18T00:04:12.9673145Z 		},
2024-12-18T00:04:12.9673420Z 		{
2024-12-18T00:04:12.9674033Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9674644Z 			"size": 137,
2024-12-18T00:04:12.9675228Z 			"digest": "sha256:cbd527c6febd14371f782c2752d8947f86adeca1e46e6e1c9dfc0dff6e32df6f"
2024-12-18T00:04:12.9675871Z 		},
2024-12-18T00:04:12.9676150Z 		{
2024-12-18T00:04:12.9676612Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9677318Z 			"size": 120,
2024-12-18T00:04:12.9677892Z 			"digest": "sha256:70c75642ca1573a70d7ab208940c68c9ec0518797e55e05b621cef283f348bbd"
2024-12-18T00:04:12.9678518Z 		},
2024-12-18T00:04:12.9678891Z 		{
2024-12-18T00:04:12.9679428Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9680050Z 			"size": 4886117515,
2024-12-18T00:04:12.9680694Z 			"digest": "sha256:975ffa249994efd3380d6baae778fb7f9ae31ef5208ceb19da52ab66f447401d"
2024-12-18T00:04:12.9681350Z 		},
2024-12-18T00:04:12.9681630Z 		{
2024-12-18T00:04:12.9682188Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9682845Z 			"size": 176,
2024-12-18T00:04:12.9683458Z 			"digest": "sha256:1de45071cffa26dd3b9959d220f37f09e3ebc5282b49c8910ca1b7045f37c763"
2024-12-18T00:04:12.9684092Z 		},
2024-12-18T00:04:12.9684373Z 		{
2024-12-18T00:04:12.9684840Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9685438Z 			"size": 908,
2024-12-18T00:04:12.9685997Z 			"digest": "sha256:6f1f1c73799125dbfc36617f78ae22c9507955fb3870b11886da704f63cd79b9"
2024-12-18T00:04:12.9686622Z 		},
2024-12-18T00:04:12.9686902Z 		{
2024-12-18T00:04:12.9687362Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9687943Z 			"size": 700,
2024-12-18T00:04:12.9688515Z 			"digest": "sha256:7feada69620ed9505fc525cf4e6d81f7d25589cb3c26fe8fef7479807372f91a"
2024-12-18T00:04:12.9689159Z 		},
2024-12-18T00:04:12.9689442Z 		{
2024-12-18T00:04:12.9689917Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9690505Z 			"size": 135,
2024-12-18T00:04:12.9691069Z 			"digest": "sha256:8da387044f457792831b74e2facde5dc612cb058a3fcc22e503a778ad0e9125e"
2024-12-18T00:04:12.9691701Z 		},
2024-12-18T00:04:12.9691980Z 		{
2024-12-18T00:04:12.9692442Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9693019Z 			"size": 32,
2024-12-18T00:04:12.9693604Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-12-18T00:04:12.9694246Z 		},
2024-12-18T00:04:12.9694528Z 		{
2024-12-18T00:04:12.9694985Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9695567Z 			"size": 159,
2024-12-18T00:04:12.9696145Z 			"digest": "sha256:25b1aa58f5caff295c81a716174c70d1207b7efc44a594cb4b4c730d11ca6f58"
2024-12-18T00:04:12.9696752Z 		},
2024-12-18T00:04:12.9697022Z 		{
2024-12-18T00:04:12.9697464Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9698022Z 			"size": 1931,
2024-12-18T00:04:12.9698572Z 			"digest": "sha256:f4c8ff23e407e7f06a6b9e83db042522c9cb14a2872e033bf0aec10e0cd68af8"
2024-12-18T00:04:12.9699176Z 		},
2024-12-18T00:04:12.9699456Z 		{
2024-12-18T00:04:12.9699917Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9700504Z 			"size": 196807254,
2024-12-18T00:04:12.9701111Z 			"digest": "sha256:d9a1d16ac9fb7fb0a5b04cf9bd8a051fedd0f6ef1467103fc8796790e941e1bb"
2024-12-18T00:04:12.9701770Z 		},
2024-12-18T00:04:12.9702048Z 		{
2024-12-18T00:04:12.9702510Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9703062Z 			"size": 163,
2024-12-18T00:04:12.9703587Z 			"digest": "sha256:4c24861203037ee0fc72cda05c5446739232f8fc027622a4982a392434699737"
2024-12-18T00:04:12.9704159Z 		},
2024-12-18T00:04:12.9704439Z 		{
2024-12-18T00:04:12.9704899Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9705483Z 			"size": 7942,
2024-12-18T00:04:12.9706181Z 			"digest": "sha256:1c1a1b6b59a8cfdf0a6b0dd0fbf35ea01e8d3d9fbfbf7a1cc3c5129697842953"
2024-12-18T00:04:12.9706849Z 		},
2024-12-18T00:04:12.9707136Z 		{
2024-12-18T00:04:12.9707595Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9708168Z 			"size": 8071,
2024-12-18T00:04:12.9708734Z 			"digest": "sha256:65ab75609fc9c1a8878dee49da05ea4c3cae04ec5ecd96bff7a59ba5f6716161"
2024-12-18T00:04:12.9709523Z 		},
2024-12-18T00:04:12.9709807Z 		{
2024-12-18T00:04:12.9710268Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9710844Z 			"size": 304,
2024-12-18T00:04:12.9711394Z 			"digest": "sha256:41fe6d82c37a17ff1a0e760821e5ffd58423b2c50138348b2d99214fa8c7f7b9"
2024-12-18T00:04:12.9712038Z 		},
2024-12-18T00:04:12.9712316Z 		{
2024-12-18T00:04:12.9712773Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9713357Z 			"size": 7632783,
2024-12-18T00:04:12.9713923Z 			"digest": "sha256:9456ad12e83f1f01e0a64ef29e45b8ce1657f0c45a5f334956fed566782f34d9"
2024-12-18T00:04:12.9714568Z 		},
2024-12-18T00:04:12.9714849Z 		{
2024-12-18T00:04:12.9715311Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9715889Z 			"size": 108,
2024-12-18T00:04:12.9716453Z 			"digest": "sha256:7dd812a149578ae7aa4d747b9c0cfdd91a1edc15b63e7ec826ca42a601c7c03f"
2024-12-18T00:04:12.9717124Z 		},
2024-12-18T00:04:12.9717403Z 		{
2024-12-18T00:04:12.9717870Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9718455Z 			"size": 54145664,
2024-12-18T00:04:12.9719034Z 			"digest": "sha256:e47d2dd30bb9d7d5f7295bbf4b68683cf7e0a3ec443e3d47696213edb61bb0ad"
2024-12-18T00:04:12.9719713Z 		},
2024-12-18T00:04:12.9720004Z 		{
2024-12-18T00:04:12.9720452Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9721000Z 			"size": 486,
2024-12-18T00:04:12.9721522Z 			"digest": "sha256:9a255e925aee3dd6711c86af0e487d1c5ff1b2cde447bd2f64f5cc6aa08a3666"
2024-12-18T00:04:12.9722143Z 		},
2024-12-18T00:04:12.9722422Z 		{
2024-12-18T00:04:12.9722862Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9723405Z 			"size": 1373229207,
2024-12-18T00:04:12.9723935Z 			"digest": "sha256:266e2409e545ef9c13ef48d69773c27f5ebe37e17c77808c473870b99ccaceca"
2024-12-18T00:04:12.9724532Z 		},
2024-12-18T00:04:12.9724814Z 		{
2024-12-18T00:04:12.9725251Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9725800Z 			"size": 106,
2024-12-18T00:04:12.9726310Z 			"digest": "sha256:100d759b6098f93451cdf0ab691600451c05cbf8de2592d370f32f6be20b6127"
2024-12-18T00:04:12.9726902Z 		},
2024-12-18T00:04:12.9727174Z 		{
2024-12-18T00:04:12.9727608Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9728143Z 			"size": 568,
2024-12-18T00:04:12.9728664Z 			"digest": "sha256:a3111847bfa2e9e8629c6c7a6cbdd52dde3359882add44762805cb47464c285f"
2024-12-18T00:04:12.9729315Z 		},
2024-12-18T00:04:12.9729607Z 		{
2024-12-18T00:04:12.9730074Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9730659Z 			"size": 36532350,
2024-12-18T00:04:12.9731245Z 			"digest": "sha256:7e6ea32f1b1cfa63f3df243c6bfa8b2659be396b488adcbdf9a9c0d9a1e65193"
2024-12-18T00:04:12.9731910Z 		},
2024-12-18T00:04:12.9732186Z 		{
2024-12-18T00:04:12.9732659Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9733244Z 			"size": 111,
2024-12-18T00:04:12.9733795Z 			"digest": "sha256:38bf4ff6a6aca492ad60288413a8a2462e07f715d05252617bb4fa942c0ca565"
2024-12-18T00:04:12.9734433Z 		},
2024-12-18T00:04:12.9734706Z 		{
2024-12-18T00:04:12.9735166Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9735746Z 			"size": 531,
2024-12-18T00:04:12.9736286Z 			"digest": "sha256:231d0f8577895b4225081015421c272a6f6c601e9b367fcf49106b9a8e3ff74c"
2024-12-18T00:04:12.9736906Z 		},
2024-12-18T00:04:12.9737178Z 		{
2024-12-18T00:04:12.9737723Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9738287Z 			"size": 26033,
2024-12-18T00:04:12.9738830Z 			"digest": "sha256:0fe4c18889ad4b2d23fac8e5c1a1bba4cc65ed4abf30d84ab871f507fd27ee03"
2024-12-18T00:04:12.9739441Z 		},
2024-12-18T00:04:12.9739708Z 		{
2024-12-18T00:04:12.9740147Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9740797Z 			"size": 106,
2024-12-18T00:04:12.9741315Z 			"digest": "sha256:c5d910c7fb9c4e239cfeafa9695f9e8b9a2892da466239b362451bb0d9a539df"
2024-12-18T00:04:12.9741918Z 		},
2024-12-18T00:04:12.9742187Z 		{
2024-12-18T00:04:12.9742627Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9743162Z 			"size": 32,
2024-12-18T00:04:12.9743681Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-12-18T00:04:12.9744285Z 		},
2024-12-18T00:04:12.9744561Z 		{
2024-12-18T00:04:12.9745007Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9745547Z 			"size": 32,
2024-12-18T00:04:12.9746115Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-12-18T00:04:12.9746728Z 		},
2024-12-18T00:04:12.9747003Z 		{
2024-12-18T00:04:12.9747442Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9747986Z 			"size": 32,
2024-12-18T00:04:12.9748502Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-12-18T00:04:12.9749108Z 		},
2024-12-18T00:04:12.9749379Z 		{
2024-12-18T00:04:12.9749819Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:04:12.9750357Z 			"size": 32,
2024-12-18T00:04:12.9750871Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-12-18T00:04:12.9751473Z 		}
2024-12-18T00:04:12.9751752Z 	]
2024-12-18T00:04:12.9752023Z }
2024-12-18T00:04:12.9752314Z + exit 0
2024-12-18T00:04:12.9797854Z ##[group]Run set -eux
2024-12-18T00:04:12.9798276Z set -eux
2024-12-18T00:04:12.9799430Z aws secretsmanager get-secret-value --secret-id docker_hub_readonly_token | jq --raw-output '.SecretString' | jq -r .docker_hub_readonly_token | docker login --username pytorchbot --password-stdin
2024-12-18T00:04:12.9807798Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:04:12.9808346Z env:
2024-12-18T00:04:12.9808656Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:04:12.9809039Z ##[endgroup]
2024-12-18T00:04:12.9842600Z + aws secretsmanager get-secret-value --secret-id docker_hub_readonly_token
2024-12-18T00:04:12.9843523Z + jq --raw-output .SecretString
2024-12-18T00:04:12.9845442Z + jq -r .docker_hub_readonly_token
2024-12-18T00:04:12.9847205Z + docker login --username pytorchbot --password-stdin
2024-12-18T00:04:13.7710776Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json.
2024-12-18T00:04:13.7711616Z Configure a credential helper to remove this warning. See
2024-12-18T00:04:13.7712349Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store
2024-12-18T00:04:13.7712837Z 
2024-12-18T00:04:13.7713162Z Login Succeeded
2024-12-18T00:04:13.7818477Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/}
2024-12-18T00:04:13.7819018Z tag=${ECR_DOCKER_IMAGE##*/}
2024-12-18T00:04:13.7819594Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}"
2024-12-18T00:04:13.7827161Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:04:13.7827687Z env:
2024-12-18T00:04:13.7827997Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:04:13.7829030Z   ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda11.8-cudnn9-py3-gcc9:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:04:13.7830064Z ##[endgroup]
2024-12-18T00:04:13.7862648Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-focal-cuda11.8-cudnn9-py3-gcc9-45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:04:13.7919638Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@release/2.6
2024-12-18T00:04:13.7920315Z with:
2024-12-18T00:04:13.7921265Z   docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda11.8-cudnn9-py3-gcc9:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:04:13.7922443Z   docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-12-18T00:04:13.7923225Z env:
2024-12-18T00:04:13.7923536Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:04:13.7923912Z ##[endgroup]
2024-12-18T00:04:13.7951433Z ##[group]Run set -x
2024-12-18T00:04:13.7951819Z set -x
2024-12-18T00:04:13.7952151Z set +e
2024-12-18T00:04:13.7952459Z 
2024-12-18T00:04:13.7952766Z login() {
2024-12-18T00:04:13.7953424Z   aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1"
2024-12-18T00:04:13.7954149Z }
2024-12-18T00:04:13.7954460Z 
2024-12-18T00:04:13.7954817Z retry () {
2024-12-18T00:04:13.7955226Z   $*  || (sleep 1 && $*) || (sleep 2 && $*)
2024-12-18T00:04:13.7955655Z }
2024-12-18T00:04:13.7956362Z 
2024-12-18T00:04:13.7956791Z retry login "${DOCKER_REGISTRY}"
2024-12-18T00:04:13.7957217Z 
2024-12-18T00:04:13.7957518Z set -e
2024-12-18T00:04:13.7957961Z # ignore output since only exit code is used for conditional
2024-12-18T00:04:13.7958618Z # only pull docker image if it's not available locally
2024-12-18T00:04:13.7959310Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then
2024-12-18T00:04:13.7959947Z   retry docker pull "${DOCKER_IMAGE}"
2024-12-18T00:04:13.7960372Z fi
2024-12-18T00:04:13.7966738Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:04:13.7967216Z env:
2024-12-18T00:04:13.7967522Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:04:13.7968473Z   DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda11.8-cudnn9-py3-gcc9:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:04:13.7969546Z   DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-12-18T00:04:13.7970057Z ##[endgroup]
2024-12-18T00:04:13.7996889Z + set +e
2024-12-18T00:04:13.7997306Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-12-18T00:04:13.7997888Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-12-18T00:04:13.8001462Z + aws ecr get-login-password --region us-east-1
2024-12-18T00:04:13.8002784Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-12-18T00:04:14.5250448Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json.
2024-12-18T00:04:14.5251227Z Configure a credential helper to remove this warning. See
2024-12-18T00:04:14.5251949Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store
2024-12-18T00:04:14.5252447Z 
2024-12-18T00:04:14.5253105Z Login Succeeded
2024-12-18T00:04:14.5266368Z + set -e
2024-12-18T00:04:14.5267357Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda11.8-cudnn9-py3-gcc9:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:04:14.5439524Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda11.8-cudnn9-py3-gcc9:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:04:14.5441102Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda11.8-cudnn9-py3-gcc9:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:04:14.7903040Z 45e1356b47a284893081276eff3000b7b534f3b1: Pulling from pytorch/pytorch-linux-focal-cuda11.8-cudnn9-py3-gcc9
2024-12-18T00:04:14.7904635Z 7a2c55901189: Pulling fs layer
2024-12-18T00:04:14.7905350Z 09d415c238d7: Pulling fs layer
2024-12-18T00:04:14.7906086Z 9fe6e2e61518: Pulling fs layer
2024-12-18T00:04:14.7906824Z 41f16248e682: Pulling fs layer
2024-12-18T00:04:14.7908039Z 95d7b7817039: Pulling fs layer
2024-12-18T00:04:14.7908795Z 8f6c90485347: Pulling fs layer
2024-12-18T00:04:14.7909556Z ab17245097e4: Pulling fs layer
2024-12-18T00:04:14.7910292Z dfecd7e9912b: Pulling fs layer
2024-12-18T00:04:14.7911032Z 464a8f745445: Pulling fs layer
2024-12-18T00:04:14.7911749Z d67c111fa588: Pulling fs layer
2024-12-18T00:04:14.7912457Z 0723abde19c0: Pulling fs layer
2024-12-18T00:04:14.7913529Z 38b3bd834f10: Pulling fs layer
2024-12-18T00:04:14.7914274Z e45523662aa5: Pulling fs layer
2024-12-18T00:04:14.7915001Z 5a6d97ee6e47: Pulling fs layer
2024-12-18T00:04:14.7915532Z 464a8f745445: Waiting
2024-12-18T00:04:14.7915890Z 8b9cee92f408: Pulling fs layer
2024-12-18T00:04:14.7916246Z 05a25e0e092f: Pulling fs layer
2024-12-18T00:04:14.7916606Z ab17245097e4: Waiting
2024-12-18T00:04:14.7916930Z d67c111fa588: Waiting
2024-12-18T00:04:14.7917262Z 32f9bd3454b2: Pulling fs layer
2024-12-18T00:04:14.7917622Z 95d7b7817039: Waiting
2024-12-18T00:04:14.7917957Z 7cef0be11b19: Pulling fs layer
2024-12-18T00:04:14.7918329Z 0723abde19c0: Waiting
2024-12-18T00:04:14.7918656Z 8f6c90485347: Waiting
2024-12-18T00:04:14.7918980Z 38b3bd834f10: Waiting
2024-12-18T00:04:14.7919300Z 41f16248e682: Waiting
2024-12-18T00:04:14.7919611Z dfecd7e9912b: Waiting
2024-12-18T00:04:14.7919954Z 3a7f27881c57: Pulling fs layer
2024-12-18T00:04:14.7920335Z 7feada69620e: Pulling fs layer
2024-12-18T00:04:14.7920715Z 1f019fb4d944: Pulling fs layer
2024-12-18T00:04:14.7921084Z f900f3284582: Pulling fs layer
2024-12-18T00:04:14.7921451Z 8b9cee92f408: Waiting
2024-12-18T00:04:14.7921780Z e45523662aa5: Waiting
2024-12-18T00:04:14.7922105Z 32f9bd3454b2: Waiting
2024-12-18T00:04:14.7922437Z 7cef0be11b19: Waiting
2024-12-18T00:04:14.7922767Z 03ef53c6b863: Pulling fs layer
2024-12-18T00:04:14.7923140Z 7feada69620e: Waiting
2024-12-18T00:04:14.7923483Z 8c33d01f9e39: Pulling fs layer
2024-12-18T00:04:14.7923865Z 49be5867b6ab: Pulling fs layer
2024-12-18T00:04:14.7924234Z 1f019fb4d944: Waiting
2024-12-18T00:04:14.7924566Z 2c921c2b9262: Pulling fs layer
2024-12-18T00:04:14.7924962Z 8c33d01f9e39: Waiting
2024-12-18T00:04:14.7925343Z f276569c48f3: Pulling fs layer
2024-12-18T00:04:14.7925810Z f900f3284582: Waiting
2024-12-18T00:04:14.7926297Z cac6488770e6: Pulling fs layer
2024-12-18T00:04:14.7926682Z 3a7f27881c57: Waiting
2024-12-18T00:04:14.7927021Z 2c921c2b9262: Waiting
2024-12-18T00:04:14.7927335Z 9695d05a4951: Pulling fs layer
2024-12-18T00:04:14.7927717Z 2857ab4d43aa: Pulling fs layer
2024-12-18T00:04:14.7928083Z cac6488770e6: Waiting
2024-12-18T00:04:14.7928414Z 9695d05a4951: Waiting
2024-12-18T00:04:14.7928743Z fcdec1f5e2fd: Pulling fs layer
2024-12-18T00:04:14.7929132Z ff1478fbefd9: Pulling fs layer
2024-12-18T00:04:14.7929501Z 2857ab4d43aa: Waiting
2024-12-18T00:04:14.7929836Z fcdec1f5e2fd: Waiting
2024-12-18T00:04:14.7930187Z f8a6d90f0b3e: Pulling fs layer
2024-12-18T00:04:14.7930538Z ff1478fbefd9: Waiting
2024-12-18T00:04:14.7930880Z 011542937262: Pulling fs layer
2024-12-18T00:04:14.7931244Z 5a6d97ee6e47: Waiting
2024-12-18T00:04:14.7931582Z 05a25e0e092f: Waiting
2024-12-18T00:04:14.7931923Z 812caf3e4338: Pulling fs layer
2024-12-18T00:04:14.7932287Z 7e2aa240b70c: Pulling fs layer
2024-12-18T00:04:14.7932655Z 011542937262: Waiting
2024-12-18T00:04:14.7932981Z 812caf3e4338: Waiting
2024-12-18T00:04:14.7933321Z a0e5fd2630de: Pulling fs layer
2024-12-18T00:04:14.7933687Z 7e2aa240b70c: Waiting
2024-12-18T00:04:14.7934006Z a7253f4f1310: Pulling fs layer
2024-12-18T00:04:14.7934376Z a0e5fd2630de: Waiting
2024-12-18T00:04:14.7934704Z f8a6d90f0b3e: Waiting
2024-12-18T00:04:14.7935030Z 03ef53c6b863: Waiting
2024-12-18T00:04:14.7935370Z d4bbe33feb5a: Pulling fs layer
2024-12-18T00:04:14.7935734Z c7da3e1fda20: Pulling fs layer
2024-12-18T00:04:14.7936101Z d4bbe33feb5a: Waiting
2024-12-18T00:04:14.7936447Z a1fa96c8688b: Pulling fs layer
2024-12-18T00:04:14.7936818Z c7da3e1fda20: Waiting
2024-12-18T00:04:14.7937129Z 49be5867b6ab: Waiting
2024-12-18T00:04:14.7937458Z a1fa96c8688b: Waiting
2024-12-18T00:04:14.7937999Z 600e7beb6ed6: Pulling fs layer
2024-12-18T00:04:14.7938700Z 7fee2a426d6e: Pulling fs layer
2024-12-18T00:04:14.7939373Z a7253f4f1310: Waiting
2024-12-18T00:04:14.7939957Z 4f4fb700ef54: Pulling fs layer
2024-12-18T00:04:14.7940653Z 600e7beb6ed6: Waiting
2024-12-18T00:04:14.7941236Z 7fee2a426d6e: Waiting
2024-12-18T00:04:14.7941597Z 321081f536b0: Pulling fs layer
2024-12-18T00:04:14.7941969Z b2671014f386: Pulling fs layer
2024-12-18T00:04:14.7942489Z 94a3028693ad: Pulling fs layer
2024-12-18T00:04:14.7942857Z 4f4fb700ef54: Waiting
2024-12-18T00:04:14.7943202Z 838f3043a48a: Pulling fs layer
2024-12-18T00:04:14.7943587Z 3bf4f9678a11: Pulling fs layer
2024-12-18T00:04:14.7943951Z 321081f536b0: Waiting
2024-12-18T00:04:14.7944258Z 838f3043a48a: Waiting
2024-12-18T00:04:14.7944586Z b2671014f386: Waiting
2024-12-18T00:04:14.7944930Z cbd527c6febd: Pulling fs layer
2024-12-18T00:04:14.7945298Z 3bf4f9678a11: Waiting
2024-12-18T00:04:14.7945637Z 70c75642ca15: Pulling fs layer
2024-12-18T00:04:14.7946063Z cbd527c6febd: Waiting
2024-12-18T00:04:14.7946420Z 975ffa249994: Pulling fs layer
2024-12-18T00:04:14.7946786Z 70c75642ca15: Waiting
2024-12-18T00:04:14.7947125Z 1de45071cffa: Pulling fs layer
2024-12-18T00:04:14.7947487Z 6f1f1c737991: Pulling fs layer
2024-12-18T00:04:14.7947864Z 8da387044f45: Pulling fs layer
2024-12-18T00:04:14.7948236Z 975ffa249994: Waiting
2024-12-18T00:04:14.7948564Z 6f1f1c737991: Waiting
2024-12-18T00:04:14.7948890Z 1de45071cffa: Waiting
2024-12-18T00:04:14.7949227Z 25b1aa58f5ca: Pulling fs layer
2024-12-18T00:04:14.7949598Z 8da387044f45: Waiting
2024-12-18T00:04:14.7949941Z f4c8ff23e407: Pulling fs layer
2024-12-18T00:04:14.7950327Z d9a1d16ac9fb: Pulling fs layer
2024-12-18T00:04:14.7950698Z f4c8ff23e407: Waiting
2024-12-18T00:04:14.7951021Z 4c2486120303: Pulling fs layer
2024-12-18T00:04:14.7951402Z 1c1a1b6b59a8: Pulling fs layer
2024-12-18T00:04:14.7951778Z 65ab75609fc9: Pulling fs layer
2024-12-18T00:04:14.7952149Z 41fe6d82c37a: Pulling fs layer
2024-12-18T00:04:14.7952521Z 9456ad12e83f: Pulling fs layer
2024-12-18T00:04:14.7952873Z 1c1a1b6b59a8: Waiting
2024-12-18T00:04:14.7953212Z 65ab75609fc9: Waiting
2024-12-18T00:04:14.7953620Z d9a1d16ac9fb: Waiting
2024-12-18T00:04:14.7954224Z 7dd812a14957: Pulling fs layer
2024-12-18T00:04:14.7954871Z 41fe6d82c37a: Waiting
2024-12-18T00:04:14.7955469Z e47d2dd30bb9: Pulling fs layer
2024-12-18T00:04:14.7956415Z 7dd812a14957: Waiting
2024-12-18T00:04:14.7957059Z 9a255e925aee: Pulling fs layer
2024-12-18T00:04:14.7957769Z 9456ad12e83f: Waiting
2024-12-18T00:04:14.7958312Z e47d2dd30bb9: Waiting
2024-12-18T00:04:14.7958904Z 266e2409e545: Pulling fs layer
2024-12-18T00:04:14.7959583Z 100d759b6098: Pulling fs layer
2024-12-18T00:04:14.7960230Z 9a255e925aee: Waiting
2024-12-18T00:04:14.7960800Z 4c2486120303: Waiting
2024-12-18T00:04:14.7961383Z a3111847bfa2: Pulling fs layer
2024-12-18T00:04:14.7962025Z 266e2409e545: Waiting
2024-12-18T00:04:14.7962587Z 100d759b6098: Waiting
2024-12-18T00:04:14.7963163Z 7e6ea32f1b1c: Pulling fs layer
2024-12-18T00:04:14.7963826Z a3111847bfa2: Waiting
2024-12-18T00:04:14.7964442Z 38bf4ff6a6ac: Pulling fs layer
2024-12-18T00:04:14.7965137Z 231d0f857789: Pulling fs layer
2024-12-18T00:04:14.7965790Z 38bf4ff6a6ac: Waiting
2024-12-18T00:04:14.7966415Z 7e6ea32f1b1c: Waiting
2024-12-18T00:04:14.7967036Z 0fe4c18889ad: Pulling fs layer
2024-12-18T00:04:14.7967607Z c5d910c7fb9c: Pulling fs layer
2024-12-18T00:04:14.7967984Z c5d910c7fb9c: Waiting
2024-12-18T00:04:14.7968315Z 231d0f857789: Waiting
2024-12-18T00:04:14.7968662Z 0fe4c18889ad: Waiting
2024-12-18T00:04:14.9357233Z 09d415c238d7: Verifying Checksum
2024-12-18T00:04:14.9357716Z 09d415c238d7: Download complete
2024-12-18T00:04:15.0198109Z 41f16248e682: Verifying Checksum
2024-12-18T00:04:15.0198930Z 41f16248e682: Download complete
2024-12-18T00:04:15.1133874Z 95d7b7817039: Verifying Checksum
2024-12-18T00:04:15.1134368Z 95d7b7817039: Download complete
2024-12-18T00:04:15.1734565Z 7a2c55901189: Download complete
2024-12-18T00:04:15.2663672Z ab17245097e4: Verifying Checksum
2024-12-18T00:04:15.2664434Z ab17245097e4: Download complete
2024-12-18T00:04:15.3647935Z dfecd7e9912b: Verifying Checksum
2024-12-18T00:04:15.3648608Z dfecd7e9912b: Download complete
2024-12-18T00:04:15.4387931Z 9fe6e2e61518: Verifying Checksum
2024-12-18T00:04:15.4388461Z 9fe6e2e61518: Download complete
2024-12-18T00:04:15.4537861Z 464a8f745445: Download complete
2024-12-18T00:04:15.5375548Z 0723abde19c0: Verifying Checksum
2024-12-18T00:04:15.5376047Z 0723abde19c0: Download complete
2024-12-18T00:04:15.6296820Z 38b3bd834f10: Download complete
2024-12-18T00:04:16.5868834Z 7a2c55901189: Pull complete
2024-12-18T00:04:16.9671916Z 09d415c238d7: Pull complete
2024-12-18T00:04:18.1681395Z 9fe6e2e61518: Pull complete
2024-12-18T00:04:18.1879569Z 41f16248e682: Pull complete
2024-12-18T00:04:18.2090874Z 95d7b7817039: Pull complete
2024-12-18T00:04:22.2672462Z e45523662aa5: Verifying Checksum
2024-12-18T00:04:22.2672962Z e45523662aa5: Download complete
2024-12-18T00:04:22.3499244Z 5a6d97ee6e47: Verifying Checksum
2024-12-18T00:04:22.3500130Z 5a6d97ee6e47: Download complete
2024-12-18T00:04:22.4239703Z 8b9cee92f408: Verifying Checksum
2024-12-18T00:04:22.4240156Z 8b9cee92f408: Download complete
2024-12-18T00:04:22.5119859Z 05a25e0e092f: Verifying Checksum
2024-12-18T00:04:22.5120379Z 05a25e0e092f: Download complete
2024-12-18T00:04:23.4843328Z 32f9bd3454b2: Verifying Checksum
2024-12-18T00:04:23.4843810Z 32f9bd3454b2: Download complete
2024-12-18T00:04:23.5731286Z 7cef0be11b19: Download complete
2024-12-18T00:04:23.6721164Z 3a7f27881c57: Verifying Checksum
2024-12-18T00:04:23.7531899Z 3a7f27881c57: Download complete
2024-12-18T00:04:23.7532575Z 7feada69620e: Verifying Checksum
2024-12-18T00:04:23.7533332Z 7feada69620e: Download complete
2024-12-18T00:04:23.8748563Z 1f019fb4d944: Verifying Checksum
2024-12-18T00:04:23.8749416Z 1f019fb4d944: Download complete
2024-12-18T00:04:29.0151729Z 8f6c90485347: Verifying Checksum
2024-12-18T00:04:29.0153156Z 8f6c90485347: Download complete
2024-12-18T00:04:29.1152846Z 03ef53c6b863: Verifying Checksum
2024-12-18T00:04:29.1153962Z 03ef53c6b863: Download complete
2024-12-18T00:04:29.1948541Z 8c33d01f9e39: Verifying Checksum
2024-12-18T00:04:29.1949990Z 8c33d01f9e39: Download complete
2024-12-18T00:04:29.2788256Z 49be5867b6ab: Download complete
2024-12-18T00:04:29.3438818Z 2c921c2b9262: Download complete
2024-12-18T00:04:29.4377132Z f276569c48f3: Download complete
2024-12-18T00:04:30.7151915Z cac6488770e6: Verifying Checksum
2024-12-18T00:04:30.7152990Z cac6488770e6: Download complete
2024-12-18T00:04:30.8077815Z 9695d05a4951: Verifying Checksum
2024-12-18T00:04:30.8078855Z 9695d05a4951: Download complete
2024-12-18T00:04:30.8921249Z 2857ab4d43aa: Verifying Checksum
2024-12-18T00:04:30.8924520Z 2857ab4d43aa: Download complete
2024-12-18T00:04:30.9833776Z fcdec1f5e2fd: Verifying Checksum
2024-12-18T00:04:30.9834545Z fcdec1f5e2fd: Download complete
2024-12-18T00:04:31.0773317Z ff1478fbefd9: Verifying Checksum
2024-12-18T00:04:31.0773799Z ff1478fbefd9: Download complete
2024-12-18T00:04:31.1435826Z f8a6d90f0b3e: Verifying Checksum
2024-12-18T00:04:31.1436721Z f8a6d90f0b3e: Download complete
2024-12-18T00:04:35.5077546Z 011542937262: Verifying Checksum
2024-12-18T00:04:35.5078422Z 011542937262: Download complete
2024-12-18T00:04:35.5894731Z 812caf3e4338: Download complete
2024-12-18T00:04:35.6784026Z 7e2aa240b70c: Verifying Checksum
2024-12-18T00:04:35.6784584Z 7e2aa240b70c: Download complete
2024-12-18T00:04:36.1340086Z a0e5fd2630de: Verifying Checksum
2024-12-18T00:04:36.1340856Z a0e5fd2630de: Download complete
2024-12-18T00:04:36.2246928Z a7253f4f1310: Verifying Checksum
2024-12-18T00:04:36.2247588Z a7253f4f1310: Download complete
2024-12-18T00:04:36.3225129Z d4bbe33feb5a: Verifying Checksum
2024-12-18T00:04:36.3225916Z d4bbe33feb5a: Download complete
2024-12-18T00:04:36.5762204Z c7da3e1fda20: Verifying Checksum
2024-12-18T00:04:36.5763091Z c7da3e1fda20: Download complete
2024-12-18T00:04:36.7484621Z a1fa96c8688b: Download complete
2024-12-18T00:04:36.8350651Z 600e7beb6ed6: Verifying Checksum
2024-12-18T00:04:36.8351581Z 600e7beb6ed6: Download complete
2024-12-18T00:04:36.8991059Z 7fee2a426d6e: Verifying Checksum
2024-12-18T00:04:36.8991905Z 7fee2a426d6e: Download complete
2024-12-18T00:04:36.9089856Z 4f4fb700ef54: Verifying Checksum
2024-12-18T00:04:36.9090663Z 4f4fb700ef54: Download complete
2024-12-18T00:04:37.0149344Z 321081f536b0: Verifying Checksum
2024-12-18T00:04:37.0886885Z b2671014f386: Verifying Checksum
2024-12-18T00:04:37.0887683Z b2671014f386: Download complete
2024-12-18T00:04:37.5868039Z 94a3028693ad: Verifying Checksum
2024-12-18T00:04:37.5868525Z 94a3028693ad: Download complete
2024-12-18T00:04:37.6579797Z 838f3043a48a: Verifying Checksum
2024-12-18T00:04:37.6580343Z 838f3043a48a: Download complete
2024-12-18T00:04:37.7437615Z 3bf4f9678a11: Verifying Checksum
2024-12-18T00:04:37.7438475Z 3bf4f9678a11: Download complete
2024-12-18T00:04:37.8326014Z cbd527c6febd: Download complete
2024-12-18T00:04:37.9285417Z 70c75642ca15: Verifying Checksum
2024-12-18T00:04:37.9285922Z 70c75642ca15: Download complete
2024-12-18T00:04:39.9462724Z d67c111fa588: Verifying Checksum
2024-12-18T00:04:39.9465217Z d67c111fa588: Download complete
2024-12-18T00:04:40.0430489Z 1de45071cffa: Verifying Checksum
2024-12-18T00:04:40.0431017Z 1de45071cffa: Download complete
2024-12-18T00:04:40.1372407Z 6f1f1c737991: Verifying Checksum
2024-12-18T00:04:40.1372942Z 6f1f1c737991: Download complete
2024-12-18T00:04:40.2089017Z 8da387044f45: Download complete
2024-12-18T00:04:40.2897121Z 25b1aa58f5ca: Verifying Checksum
2024-12-18T00:04:40.2897645Z 25b1aa58f5ca: Download complete
2024-12-18T00:04:40.3859788Z f4c8ff23e407: Verifying Checksum
2024-12-18T00:04:40.3860914Z f4c8ff23e407: Download complete
2024-12-18T00:04:42.4154585Z d9a1d16ac9fb: Verifying Checksum
2024-12-18T00:04:42.4155085Z d9a1d16ac9fb: Download complete
2024-12-18T00:04:42.5073540Z 4c2486120303: Download complete
2024-12-18T00:04:42.5983713Z 1c1a1b6b59a8: Download complete
2024-12-18T00:04:42.6860376Z 65ab75609fc9: Verifying Checksum
2024-12-18T00:04:42.6860862Z 65ab75609fc9: Download complete
2024-12-18T00:04:42.7720943Z 41fe6d82c37a: Verifying Checksum
2024-12-18T00:04:42.7721809Z 41fe6d82c37a: Download complete
2024-12-18T00:04:42.9185162Z 9456ad12e83f: Verifying Checksum
2024-12-18T00:04:42.9185893Z 9456ad12e83f: Download complete
2024-12-18T00:04:42.9987846Z 7dd812a14957: Verifying Checksum
2024-12-18T00:04:42.9988694Z 7dd812a14957: Download complete
2024-12-18T00:04:43.6119887Z e47d2dd30bb9: Verifying Checksum
2024-12-18T00:04:43.6120799Z e47d2dd30bb9: Download complete
2024-12-18T00:04:43.6877261Z 9a255e925aee: Verifying Checksum
2024-12-18T00:04:43.6877733Z 9a255e925aee: Download complete
2024-12-18T00:04:48.2907583Z 8f6c90485347: Pull complete
2024-12-18T00:04:48.7138180Z ab17245097e4: Pull complete
2024-12-18T00:04:48.7571161Z dfecd7e9912b: Pull complete
2024-12-18T00:04:48.7756396Z 464a8f745445: Pull complete
2024-12-18T00:04:53.4716899Z f900f3284582: Verifying Checksum
2024-12-18T00:04:53.4717692Z f900f3284582: Download complete
2024-12-18T00:04:53.5899828Z 100d759b6098: Download complete
2024-12-18T00:04:53.6794471Z a3111847bfa2: Verifying Checksum
2024-12-18T00:04:53.6794968Z a3111847bfa2: Download complete
2024-12-18T00:04:54.1121103Z 7e6ea32f1b1c: Verifying Checksum
2024-12-18T00:04:54.1121985Z 7e6ea32f1b1c: Download complete
2024-12-18T00:04:54.1739244Z 38bf4ff6a6ac: Verifying Checksum
2024-12-18T00:04:54.1740827Z 38bf4ff6a6ac: Download complete
2024-12-18T00:04:54.2566436Z 231d0f857789: Verifying Checksum
2024-12-18T00:04:54.2566983Z 231d0f857789: Download complete
2024-12-18T00:04:54.3449462Z 0fe4c18889ad: Download complete
2024-12-18T00:04:54.4182016Z c5d910c7fb9c: Download complete
2024-12-18T00:04:57.4755738Z 266e2409e545: Verifying Checksum
2024-12-18T00:04:57.4756750Z 266e2409e545: Download complete
2024-12-18T00:05:25.4290766Z d67c111fa588: Pull complete
2024-12-18T00:05:25.8817049Z 0723abde19c0: Pull complete
2024-12-18T00:05:26.3279206Z 38b3bd834f10: Pull complete
2024-12-18T00:05:26.8410390Z 975ffa249994: Verifying Checksum
2024-12-18T00:05:26.8411464Z 975ffa249994: Download complete
2024-12-18T00:05:40.3814566Z e45523662aa5: Pull complete
2024-12-18T00:05:40.7269445Z 5a6d97ee6e47: Pull complete
2024-12-18T00:05:41.1551126Z 8b9cee92f408: Pull complete
2024-12-18T00:05:41.6156795Z 05a25e0e092f: Pull complete
2024-12-18T00:05:44.8796927Z 32f9bd3454b2: Pull complete
2024-12-18T00:05:45.3343350Z 7cef0be11b19: Pull complete
2024-12-18T00:05:45.5816901Z 3a7f27881c57: Pull complete
2024-12-18T00:05:46.0446818Z 7feada69620e: Pull complete
2024-12-18T00:05:46.4926276Z 1f019fb4d944: Pull complete
2024-12-18T00:06:56.6846535Z f900f3284582: Pull complete
2024-12-18T00:06:57.1468866Z 03ef53c6b863: Pull complete
2024-12-18T00:06:57.6290669Z 8c33d01f9e39: Pull complete
2024-12-18T00:06:58.0727994Z 49be5867b6ab: Pull complete
2024-12-18T00:06:58.3977686Z 2c921c2b9262: Pull complete
2024-12-18T00:06:58.7267975Z f276569c48f3: Pull complete
2024-12-18T00:07:03.4017503Z cac6488770e6: Pull complete
2024-12-18T00:07:03.8323397Z 9695d05a4951: Pull complete
2024-12-18T00:07:04.2877749Z 2857ab4d43aa: Pull complete
2024-12-18T00:07:04.7339159Z fcdec1f5e2fd: Pull complete
2024-12-18T00:07:05.1855579Z ff1478fbefd9: Pull complete
2024-12-18T00:07:05.6301162Z f8a6d90f0b3e: Pull complete
2024-12-18T00:07:16.4357167Z 011542937262: Pull complete
2024-12-18T00:07:16.8913678Z 812caf3e4338: Pull complete
2024-12-18T00:07:17.3433454Z 7e2aa240b70c: Pull complete
2024-12-18T00:07:18.6727151Z a0e5fd2630de: Pull complete
2024-12-18T00:07:19.1477928Z a7253f4f1310: Pull complete
2024-12-18T00:07:19.5904509Z d4bbe33feb5a: Pull complete
2024-12-18T00:07:20.3984542Z c7da3e1fda20: Pull complete
2024-12-18T00:07:20.8484198Z a1fa96c8688b: Pull complete
2024-12-18T00:07:21.2598515Z 600e7beb6ed6: Pull complete
2024-12-18T00:07:21.3703039Z 7fee2a426d6e: Pull complete
2024-12-18T00:07:21.4937186Z 4f4fb700ef54: Pull complete
2024-12-18T00:07:21.9198134Z 321081f536b0: Pull complete
2024-12-18T00:07:22.3114243Z b2671014f386: Pull complete
2024-12-18T00:07:25.5772884Z 94a3028693ad: Pull complete
2024-12-18T00:07:25.9601841Z 838f3043a48a: Pull complete
2024-12-18T00:07:26.2996920Z 3bf4f9678a11: Pull complete
2024-12-18T00:07:27.0803280Z cbd527c6febd: Pull complete
2024-12-18T00:07:27.4995872Z 70c75642ca15: Pull complete
2024-12-18T00:09:19.8245763Z 975ffa249994: Pull complete
2024-12-18T00:09:19.8449637Z 1de45071cffa: Pull complete
2024-12-18T00:09:19.8646637Z 6f1f1c737991: Pull complete
2024-12-18T00:09:19.9027817Z 8da387044f45: Pull complete
2024-12-18T00:09:19.9409992Z 25b1aa58f5ca: Pull complete
2024-12-18T00:09:19.9615721Z f4c8ff23e407: Pull complete
2024-12-18T00:09:29.1804880Z d9a1d16ac9fb: Pull complete
2024-12-18T00:09:29.6257146Z 4c2486120303: Pull complete
2024-12-18T00:09:30.0723232Z 1c1a1b6b59a8: Pull complete
2024-12-18T00:09:30.5130213Z 65ab75609fc9: Pull complete
2024-12-18T00:09:30.9651512Z 41fe6d82c37a: Pull complete
2024-12-18T00:09:32.7896132Z 9456ad12e83f: Pull complete
2024-12-18T00:09:33.2436605Z 7dd812a14957: Pull complete
2024-12-18T00:09:36.1331206Z e47d2dd30bb9: Pull complete
2024-12-18T00:09:36.5915169Z 9a255e925aee: Pull complete
2024-12-18T00:09:52.5840826Z 266e2409e545: Pull complete
2024-12-18T00:09:53.0332408Z 100d759b6098: Pull complete
2024-12-18T00:09:53.4858283Z a3111847bfa2: Pull complete
2024-12-18T00:09:54.5287353Z 7e6ea32f1b1c: Pull complete
2024-12-18T00:09:54.9805359Z 38bf4ff6a6ac: Pull complete
2024-12-18T00:09:55.4323843Z 231d0f857789: Pull complete
2024-12-18T00:09:55.8918632Z 0fe4c18889ad: Pull complete
2024-12-18T00:09:56.1625256Z c5d910c7fb9c: Pull complete
2024-12-18T00:09:57.7627559Z Digest: sha256:52918bcdb0e370d1b9413099049464295e6c36e0a09cff6cff645b519e6da502
2024-12-18T00:09:57.8124291Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda11.8-cudnn9-py3-gcc9:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:09:57.8211541Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda11.8-cudnn9-py3-gcc9:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:09:57.8265225Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2024-12-18T00:09:57.8266559Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2024-12-18T00:09:57.8275285Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:09:57.8275768Z env:
2024-12-18T00:09:57.8276072Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:09:57.8276723Z ##[endgroup]
2024-12-18T00:09:57.8652003Z ##[group]Run pytorch/test-infra/.github/actions/setup-nvidia@release/2.6
2024-12-18T00:09:57.8652624Z with:
2024-12-18T00:09:57.8652939Z   driver-version: 550.54.15
2024-12-18T00:09:57.8653282Z env:
2024-12-18T00:09:57.8653581Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:09:57.8653937Z ##[endgroup]
2024-12-18T00:09:57.8760548Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482
2024-12-18T00:09:57.8761070Z with:
2024-12-18T00:09:57.8761374Z   timeout_minutes: 10
2024-12-18T00:09:57.8761717Z   max_attempts: 3
2024-12-18T00:09:57.8795410Z   command: # Is it disgusting to have a full shell script here in this github action? Sure
# But is it the best way to make it so that this action relies on nothing else? Absolutely
set -eou pipefail

DISTRIBUTION=$(. /etc/os-release;echo $ID$VERSION_ID)
DRIVER_FN="NVIDIA-Linux-x86_64-${DRIVER_VERSION}.run"

install_nvidia_docker2_amzn2() {
    (
        set -x
        # Needed for yum-config-manager
        sudo yum install -y yum-utils
        if [[ "${DISTRIBUTION}" == "amzn2023" ]] ; then
          YUM_REPO_URL="https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo"
        else
          # Amazon Linux 2
          YUM_REPO_URL="https://nvidia.github.io/nvidia-docker/${DISTRIBUTION}/nvidia-docker.repo"
        fi

        sudo yum-config-manager --add-repo "${YUM_REPO_URL}"
        sudo yum install -y nvidia-docker2 nvidia-container-toolkit-1.16.2
        sudo systemctl restart docker
    )
}

install_nvidia_docker2_ubuntu20() {
    (
        set -x
        # Install nvidia-driver package if not installed
        status="$(dpkg-query -W --showformat='${db:Status-Status}' nvidia-docker2 2>&1)"
        if [ ! $? = 0 ] || [ ! "$status" = installed ]; then
          sudo apt-get install -y nvidia-docker2 nvidia-container-toolkit-1.16.2
          sudo systemctl restart docker
        fi
    )
}

pre_install_nvidia_driver_amzn2() {
    (
        # Purge any nvidia driver installed from RHEL repo
        sudo yum remove -y nvidia-driver-latest-dkms
    )
}

install_nvidia_driver_common() {
    (
        # Try to gather more information about the runner and its existing NVIDIA driver if any
        echo "Before installing NVIDIA driver"
        lspci
        lsmod
        modinfo nvidia || true

        HAS_NVIDIA_DRIVER=0
        # Check if NVIDIA driver has already been installed
        if [ -x "$(command -v nvidia-smi)" ]; then
            set +e
            # The driver exists, check its version next. Also check only the first GPU if there are more than one of them
            # so that the same driver version is not print over multiple lines
            INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0)
            NVIDIA_SMI_STATUS=$?

            if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then
                echo "Failed to get NVIDIA driver version ($INSTALLED_DRIVER_VERSION). Continuing"
            elif [ "$INSTALLED_DRIVER_VERSION" != "$DRIVER_VERSION" ]; then
                echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has been installed, but we expect to have $DRIVER_VERSION instead. Continuing"
            else
                HAS_NVIDIA_DRIVER=1
                echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has already been installed. Skipping NVIDIA driver installation"
            fi
            set -e
        fi

        if [ "$HAS_NVIDIA_DRIVER" -eq 0 ]; then
            # CAUTION: this may need to be updated in future
            if [ "${DISTRIBUTION}" != ubuntu20.04 ]; then
                  sudo yum groupinstall -y "Development Tools"
                  # ensure our kernel install is the same as our underlying kernel,
                  # groupinstall "Development Tools" has a habit of mismatching kernel headers
                  sudo yum install -y "kernel-devel-uname-r == $(uname -r)"
                  sudo modprobe backlight
            fi
            sudo curl -fsL -o /tmp/nvidia_driver "https://s3.amazonaws.com/ossci-linux/nvidia_driver/$DRIVER_FN"

            set +e
            sudo /bin/bash /tmp/nvidia_driver -s --no-drm
            NVIDIA_INSTALLATION_STATUS=$?

            RESET_GPU=0
            if [ "$NVIDIA_INSTALLATION_STATUS" -ne 0 ]; then
                sudo cat /var/log/nvidia-installer.log
                # Fail to install NVIDIA driver, try to reset the GPU
                RESET_GPU=1
            elif [ -x "$(command -v nvidia-smi)" ]; then
                # Check again if nvidia-smi works even if the driver installation completes successfully
                INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0)
                NVIDIA_SMI_STATUS=$?

                if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then
                    RESET_GPU=1
                fi
            fi

            if [ "$RESET_GPU" -eq 1 ]; then
                NVIDIA_DEVICES=$(lspci -D | grep -i NVIDIA | cut -d' ' -f1)
                # The GPU can get stuck in a failure state if somehow the test crashs the GPU microcode. When this
                # happens, we'll try to reset all NVIDIA devices https://github.com/pytorch/pytorch/issues/88388
                for PCI_ID in $NVIDIA_DEVICES; do
                    DEVICE_ENABLED=$(cat /sys/bus/pci/devices/$PCI_ID/enable)

                    echo "Reseting $PCI_ID (enabled state: $DEVICE_ENABLED)"
                    # This requires sudo permission of course
                    echo "1" | sudo tee /sys/bus/pci/devices/$PCI_ID/reset
                    sleep 1
                done
            fi

            sudo rm -fv /tmp/nvidia_driver
            set -e
        fi
    )
}

post_install_nvidia_driver_common() {
    (
        sudo modprobe nvidia || true
        echo "After installing NVIDIA driver"
        lspci
        lsmod
        modinfo nvidia || true

        (
            set +e

            nvidia-smi
            # NB: Annoyingly, nvidia-smi command returns successfully with return code 0 even in
            # the case where the driver has already crashed as it still can get the driver version
            # and some basic information like the bus ID.  However, the rest of the information
            # would be missing (ERR!), for example:
            #
            # +-----------------------------------------------------------------------------+
            # | NVIDIA-SMI 525.89.02    Driver Version: 525.89.02    CUDA Version: 12.0     |
            # |-------------------------------+----------------------+----------------------+
            # | GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
            # | Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
            # |                               |                      |               MIG M. |
            # |===============================+======================+======================|
            # |   0  ERR!                Off  | 00000000:00:1E.0 Off |                 ERR! |
            # |ERR!  ERR! ERR!    ERR! / ERR! |   4184MiB / 23028MiB |    ERR!      Default |
            # |                               |                      |                 ERR! |
            # +-------------------------------+----------------------+----------------------+
            #
            # +-----------------------------------------------------------------------------+
            # | Processes:                                                                  |
            # |  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
            # |        ID   ID                                                   Usage      |
            # |=============================================================================|
            # +-----------------------------------------------------------------------------+
            #
            # This should be reported as a failure instead as it will guarantee to fail when
            # Docker tries to run with --gpus all
            #
            # So, the correct check here is to query one of the missing piece of info like
            # GPU name, so that the command can fail accordingly
            nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0
            NVIDIA_SMI_STATUS=$?

            # Allowable exit statuses for nvidia-smi, see: https://github.com/NVIDIA/gpu-operator/issues/285
            if [ "$NVIDIA_SMI_STATUS" -eq 0 ] || [ "$NVIDIA_SMI_STATUS" -eq 14 ]; then
                echo "INFO: Ignoring allowed status ${NVIDIA_SMI_STATUS}"
            else
                echo "ERROR: nvidia-smi exited with unresolved status ${NVIDIA_SMI_STATUS}"
                exit ${NVIDIA_SMI_STATUS}
            fi
            set -e
        )
    )
}

install_nvidia_driver_amzn2() {
    (
        set -x
        pre_install_nvidia_driver_amzn2
        install_nvidia_driver_common
        post_install_nvidia_driver_common
    )
}

install_nvidia_driver_ubuntu20() {
    (
        set -x
        install_nvidia_driver_common
        post_install_nvidia_driver_common
    )
}

echo "== Installing nvidia driver ${DRIVER_FN} =="
case "${DISTRIBUTION}" in
    amzn*)
        install_nvidia_driver_amzn2
        ;;
    ubuntu20.04)
        install_nvidia_driver_ubuntu20
        ;;
    *)
        echo "ERROR: Unknown distribution ${DISTRIBUTION}"
        exit 1
        ;;
esac

# Install container toolkit based on distribution
echo "== Installing nvidia container toolkit for ${DISTRIBUTION} =="
case "${DISTRIBUTION}" in
    amzn*)
        install_nvidia_docker2_amzn2
        ;;
    ubuntu20.04)
        install_nvidia_docker2_ubuntu20
        ;;
    *)
        echo "ERROR: Unknown distribution ${DISTRIBUTION}"
        exit 1
        ;;
esac
echo "GPU_FLAG=--gpus all -e NVIDIA_DRIVER_CAPABILITIES=all" >> "${GITHUB_ENV}"

# Fix https://github.com/NVIDIA/nvidia-docker/issues/1648 on runners with
# more than one GPUs. This just needs to be run once. The command fails
# on subsequent runs and complains that the mode is already on, but that's
# ok
sudo nvidia-persistenced || true
# This should show persistence mode ON
nvidia-smi

2024-12-18T00:09:57.8828922Z   retry_wait_seconds: 10
2024-12-18T00:09:57.8829308Z   polling_interval_seconds: 1
2024-12-18T00:09:57.8829696Z   warning_on_retry: true
2024-12-18T00:09:57.8830119Z   continue_on_error: false
2024-12-18T00:09:57.8830656Z env:
2024-12-18T00:09:57.8830958Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:09:57.8831322Z   DRIVER_VERSION: 550.54.15
2024-12-18T00:09:57.8831680Z ##[endgroup]
2024-12-18T00:09:57.9745563Z == Installing nvidia driver NVIDIA-Linux-x86_64-550.54.15.run ==
2024-12-18T00:09:57.9747679Z + pre_install_nvidia_driver_amzn2
2024-12-18T00:09:57.9749977Z + sudo yum remove -y nvidia-driver-latest-dkms
2024-12-18T00:09:58.4806291Z No match for argument: nvidia-driver-latest-dkms
2024-12-18T00:09:58.4806844Z No packages marked for removal.
2024-12-18T00:09:58.4887868Z Dependencies resolved.
2024-12-18T00:09:58.4901842Z Nothing to do.
2024-12-18T00:09:58.4904689Z Complete!
2024-12-18T00:09:58.6881577Z + install_nvidia_driver_common
2024-12-18T00:09:58.6886897Z + echo 'Before installing NVIDIA driver'
2024-12-18T00:09:58.6887616Z Before installing NVIDIA driver
2024-12-18T00:09:58.6890914Z + lspci
2024-12-18T00:09:58.7091399Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] (rev 02)
2024-12-18T00:09:58.7092135Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II]
2024-12-18T00:09:58.7092844Z 00:01.1 IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]
2024-12-18T00:09:58.7093516Z 00:01.3 Bridge: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 01)
2024-12-18T00:09:58.7094096Z 00:02.0 VGA compatible controller: Cirrus Logic GD 5446
2024-12-18T00:09:58.7095222Z 00:03.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA)
2024-12-18T00:09:58.7095997Z 00:1e.0 VGA compatible controller: NVIDIA Corporation GM204GL [Tesla M60] (rev a1)
2024-12-18T00:09:58.7096743Z 00:1f.0 Unassigned class [ff80]: XenSource, Inc. Xen Platform Device (rev 01)
2024-12-18T00:09:58.7097733Z + lsmod
2024-12-18T00:09:58.7136386Z Module                  Size  Used by
2024-12-18T00:09:58.7136838Z veth                   36864  0
2024-12-18T00:09:58.7137224Z nvidia_modeset       1351680  0
2024-12-18T00:09:58.7137615Z video                  65536  1 nvidia_modeset
2024-12-18T00:09:58.7138040Z wmi                    36864  1 video
2024-12-18T00:09:58.7138428Z nvidia_uvm           4706304  0
2024-12-18T00:09:58.7138866Z nvidia              54071296  7 nvidia_uvm,nvidia_modeset
2024-12-18T00:09:58.7139329Z drm                   602112  1 nvidia
2024-12-18T00:09:58.7139741Z drm_panel_orientation_quirks    32768  1 drm
2024-12-18T00:09:58.7140465Z backlight              24576  3 video,drm,nvidia_modeset
2024-12-18T00:09:58.7140954Z i2c_core              106496  2 nvidia,drm
2024-12-18T00:09:58.7141366Z xt_conntrack           16384  1
2024-12-18T00:09:58.7141741Z nft_chain_nat          16384  3
2024-12-18T00:09:58.7142100Z xt_MASQUERADE          20480  1
2024-12-18T00:09:58.7142547Z nf_nat                 57344  2 nft_chain_nat,xt_MASQUERADE
2024-12-18T00:09:58.7143015Z nf_conntrack_netlink    57344  0
2024-12-18T00:09:58.7143569Z nf_conntrack          184320  4 xt_conntrack,nf_nat,nf_conntrack_netlink,xt_MASQUERADE
2024-12-18T00:09:58.7144167Z nf_defrag_ipv6         24576  1 nf_conntrack
2024-12-18T00:09:58.7144591Z nf_defrag_ipv4         16384  1 nf_conntrack
2024-12-18T00:09:58.7145011Z xfrm_user              57344  1
2024-12-18T00:09:58.7145392Z xfrm_algo              16384  1 xfrm_user
2024-12-18T00:09:58.7145800Z xt_addrtype            16384  2
2024-12-18T00:09:58.7146170Z nft_compat             20480  4
2024-12-18T00:09:58.7146584Z nf_tables             311296  57 nft_compat,nft_chain_nat
2024-12-18T00:09:58.7147158Z nfnetlink              20480  4 nft_compat,nf_conntrack_netlink,nf_tables
2024-12-18T00:09:58.7147680Z br_netfilter           36864  0
2024-12-18T00:09:58.7148079Z bridge                323584  1 br_netfilter
2024-12-18T00:09:58.7148514Z stp                    16384  1 bridge
2024-12-18T00:09:58.7148934Z llc                    16384  2 bridge,stp
2024-12-18T00:09:58.7149324Z overlay               167936  0
2024-12-18T00:09:58.7149687Z tls                   114688  0
2024-12-18T00:09:58.7150056Z nls_ascii              16384  1
2024-12-18T00:09:58.7150421Z nls_cp437              20480  1
2024-12-18T00:09:58.7150764Z vfat                   24576  1
2024-12-18T00:09:58.7151130Z sunrpc                692224  1
2024-12-18T00:09:58.7151495Z ata_piix               45056  0
2024-12-18T00:09:58.7151860Z fat                    86016  1 vfat
2024-12-18T00:09:58.7152257Z libata                401408  1 ata_piix
2024-12-18T00:09:58.7152649Z scsi_mod              290816  1 libata
2024-12-18T00:09:58.7153042Z ena                   167936  0
2024-12-18T00:09:58.7153445Z scsi_common            16384  2 scsi_mod,libata
2024-12-18T00:09:58.7154019Z ghash_clmulni_intel    16384  0
2024-12-18T00:09:58.7154665Z i8042                  45056  0
2024-12-18T00:09:58.7155043Z serio                  28672  3 i8042
2024-12-18T00:09:58.7155440Z button                 24576  0
2024-12-18T00:09:58.7155812Z sch_fq_codel           20480  9
2024-12-18T00:09:58.7156700Z dm_mod                188416  0
2024-12-18T00:09:58.7157237Z fuse                  163840  1
2024-12-18T00:09:58.7157585Z configfs               57344  1
2024-12-18T00:09:58.7157948Z loop                   36864  0
2024-12-18T00:09:58.7158315Z dax                    45056  1 dm_mod
2024-12-18T00:09:58.7158704Z dmi_sysfs              20480  0
2024-12-18T00:09:58.7159072Z crc32_pclmul           16384  0
2024-12-18T00:09:58.7159428Z crc32c_intel           24576  0
2024-12-18T00:09:58.7159816Z + modinfo nvidia
2024-12-18T00:09:58.7160350Z filename:       /lib/modules/6.1.109-118.189.amzn2023.x86_64/kernel/drivers/video/nvidia.ko
2024-12-18T00:09:58.7161158Z alias:          char-major-195-*
2024-12-18T00:09:58.7161719Z version:        550.54.15
2024-12-18T00:09:58.7162082Z supported:      external
2024-12-18T00:09:58.7162639Z license:        NVIDIA
2024-12-18T00:09:58.7163149Z firmware:       nvidia/550.54.15/gsp_tu10x.bin
2024-12-18T00:09:58.7163644Z firmware:       nvidia/550.54.15/gsp_ga10x.bin
2024-12-18T00:09:58.7164154Z srcversion:     833721318DA517F0C2FEC97
2024-12-18T00:09:58.7164858Z alias:          pci:v000010DEd*sv*sd*bc06sc80i00*
2024-12-18T00:09:58.7165435Z alias:          pci:v000010DEd*sv*sd*bc03sc02i00*
2024-12-18T00:09:58.7165918Z alias:          pci:v000010DEd*sv*sd*bc03sc00i00*
2024-12-18T00:09:58.7166360Z depends:        i2c-core,drm
2024-12-18T00:09:58.7166736Z retpoline:      Y
2024-12-18T00:09:58.7167062Z name:           nvidia
2024-12-18T00:09:58.7167548Z vermagic:       6.1.109-118.189.amzn2023.x86_64 SMP preempt mod_unload modversions 
2024-12-18T00:09:58.7168199Z parm:           NvSwitchRegDwords:NvSwitch regkey (charp)
2024-12-18T00:09:58.7169017Z parm:           NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp)
2024-12-18T00:09:58.7169635Z parm:           NVreg_ResmanDebugLevel:int
2024-12-18T00:09:58.7170100Z parm:           NVreg_RmLogonRC:int
2024-12-18T00:09:58.7170516Z parm:           NVreg_ModifyDeviceFiles:int
2024-12-18T00:09:58.7170968Z parm:           NVreg_DeviceFileUID:int
2024-12-18T00:09:58.7171402Z parm:           NVreg_DeviceFileGID:int
2024-12-18T00:09:58.7171838Z parm:           NVreg_DeviceFileMode:int
2024-12-18T00:09:58.7172353Z parm:           NVreg_InitializeSystemMemoryAllocations:int
2024-12-18T00:09:58.7172871Z parm:           NVreg_UsePageAttributeTable:int
2024-12-18T00:09:58.7173340Z parm:           NVreg_EnablePCIeGen3:int
2024-12-18T00:09:58.7173766Z parm:           NVreg_EnableMSI:int
2024-12-18T00:09:58.7174180Z parm:           NVreg_TCEBypassMode:int
2024-12-18T00:09:58.7174631Z parm:           NVreg_EnableStreamMemOPs:int
2024-12-18T00:09:58.7175121Z parm:           NVreg_RestrictProfilingToAdminUsers:int
2024-12-18T00:09:58.7175669Z parm:           NVreg_PreserveVideoMemoryAllocations:int
2024-12-18T00:09:58.7176202Z parm:           NVreg_EnableS0ixPowerManagement:int
2024-12-18T00:09:58.7176788Z parm:           NVreg_S0ixPowerManagementVideoMemoryThreshold:int
2024-12-18T00:09:58.7177353Z parm:           NVreg_DynamicPowerManagement:int
2024-12-18T00:09:58.7177935Z parm:           NVreg_DynamicPowerManagementVideoMemoryThreshold:int
2024-12-18T00:09:58.7178480Z parm:           NVreg_EnableGpuFirmware:int
2024-12-18T00:09:58.7178959Z parm:           NVreg_EnableGpuFirmwareLogs:int
2024-12-18T00:09:58.7179478Z parm:           NVreg_OpenRmEnableUnsupportedGpus:int
2024-12-18T00:09:58.7180002Z parm:           NVreg_EnableUserNUMAManagement:int
2024-12-18T00:09:58.7180474Z parm:           NVreg_MemoryPoolSize:int
2024-12-18T00:09:58.7180907Z parm:           NVreg_KMallocHeapMaxSize:int
2024-12-18T00:09:58.7181368Z parm:           NVreg_VMallocHeapMaxSize:int
2024-12-18T00:09:58.7181873Z parm:           NVreg_IgnoreMMIOCheck:int
2024-12-18T00:09:58.7182320Z parm:           NVreg_NvLinkDisable:int
2024-12-18T00:09:58.7182804Z parm:           NVreg_EnablePCIERelaxedOrderingMode:int
2024-12-18T00:09:58.7183304Z parm:           NVreg_RegisterPCIDriver:int
2024-12-18T00:09:58.7183765Z parm:           NVreg_EnableResizableBar:int
2024-12-18T00:09:58.7184236Z parm:           NVreg_EnableDbgBreakpoint:int
2024-12-18T00:09:58.7184716Z parm:           NVreg_EnableNonblockingOpen:int
2024-12-18T00:09:58.7185188Z parm:           NVreg_RegistryDwords:charp
2024-12-18T00:09:58.7185647Z parm:           NVreg_RegistryDwordsPerDevice:charp
2024-12-18T00:09:58.7186106Z parm:           NVreg_RmMsg:charp
2024-12-18T00:09:58.7186517Z parm:           NVreg_GpuBlacklist:charp
2024-12-18T00:09:58.7187056Z parm:           NVreg_TemporaryFilePath:charp
2024-12-18T00:09:58.7187513Z parm:           NVreg_ExcludedGpus:charp
2024-12-18T00:09:58.7187940Z parm:           NVreg_DmaRemapPeerMmio:int
2024-12-18T00:09:58.7188403Z parm:           NVreg_RmNvlinkBandwidth:charp
2024-12-18T00:09:58.7188865Z parm:           NVreg_ImexChannelCount:int
2024-12-18T00:09:58.7189306Z parm:           rm_firmware_active:charp
2024-12-18T00:09:58.7189961Z + HAS_NVIDIA_DRIVER=0
2024-12-18T00:09:58.7190346Z ++ command -v nvidia-smi
2024-12-18T00:09:58.7190702Z + '[' -x /usr/bin/nvidia-smi ']'
2024-12-18T00:09:58.7191077Z + set +e
2024-12-18T00:09:58.7191514Z ++ nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0
2024-12-18T00:09:58.7446431Z + INSTALLED_DRIVER_VERSION=550.54.15
2024-12-18T00:09:58.7447110Z + NVIDIA_SMI_STATUS=0
2024-12-18T00:09:58.7447451Z + '[' 0 -ne 0 ']'
2024-12-18T00:09:58.7447779Z + '[' 550.54.15 '!=' 550.54.15 ']'
2024-12-18T00:09:58.7448301Z + HAS_NVIDIA_DRIVER=1
2024-12-18T00:09:58.7449246Z + echo 'NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation'
2024-12-18T00:09:58.7449901Z + set -e
2024-12-18T00:09:58.7450495Z NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation
2024-12-18T00:09:58.7451419Z + '[' 1 -eq 0 ']'
2024-12-18T00:09:58.7451778Z + post_install_nvidia_driver_common
2024-12-18T00:09:58.7455560Z + sudo modprobe nvidia
2024-12-18T00:09:58.9177426Z + echo 'After installing NVIDIA driver'
2024-12-18T00:09:58.9178301Z + lspci
2024-12-18T00:09:58.9178878Z After installing NVIDIA driver
2024-12-18T00:09:58.9398925Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] (rev 02)
2024-12-18T00:09:58.9399682Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II]
2024-12-18T00:09:58.9400402Z 00:01.1 IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]
2024-12-18T00:09:58.9401081Z 00:01.3 Bridge: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 01)
2024-12-18T00:09:58.9401663Z 00:02.0 VGA compatible controller: Cirrus Logic GD 5446
2024-12-18T00:09:58.9402287Z 00:03.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA)
2024-12-18T00:09:58.9403260Z 00:1e.0 VGA compatible controller: NVIDIA Corporation GM204GL [Tesla M60] (rev a1)
2024-12-18T00:09:58.9404017Z 00:1f.0 Unassigned class [ff80]: XenSource, Inc. Xen Platform Device (rev 01)
2024-12-18T00:09:58.9404615Z + lsmod
2024-12-18T00:09:58.9431511Z Module                  Size  Used by
2024-12-18T00:09:58.9431949Z veth                   36864  0
2024-12-18T00:09:58.9432336Z nvidia_modeset       1351680  0
2024-12-18T00:09:58.9432726Z video                  65536  1 nvidia_modeset
2024-12-18T00:09:58.9433158Z wmi                    36864  1 video
2024-12-18T00:09:58.9433554Z nvidia_uvm           4706304  0
2024-12-18T00:09:58.9433985Z nvidia              54071296  7 nvidia_uvm,nvidia_modeset
2024-12-18T00:09:58.9434445Z drm                   602112  1 nvidia
2024-12-18T00:09:58.9434868Z drm_panel_orientation_quirks    32768  1 drm
2024-12-18T00:09:58.9435379Z backlight              24576  3 video,drm,nvidia_modeset
2024-12-18T00:09:58.9435880Z i2c_core              106496  2 nvidia,drm
2024-12-18T00:09:58.9436277Z xt_conntrack           16384  1
2024-12-18T00:09:58.9436793Z nft_chain_nat          16384  3
2024-12-18T00:09:58.9437234Z xt_MASQUERADE          20480  1
2024-12-18T00:09:58.9437693Z nf_nat                 57344  2 nft_chain_nat,xt_MASQUERADE
2024-12-18T00:09:58.9438189Z nf_conntrack_netlink    57344  0
2024-12-18T00:09:58.9438751Z nf_conntrack          184320  4 xt_conntrack,nf_nat,nf_conntrack_netlink,xt_MASQUERADE
2024-12-18T00:09:58.9439353Z nf_defrag_ipv6         24576  1 nf_conntrack
2024-12-18T00:09:58.9439783Z nf_defrag_ipv4         16384  1 nf_conntrack
2024-12-18T00:09:58.9440217Z xfrm_user              57344  1
2024-12-18T00:09:58.9440607Z xfrm_algo              16384  1 xfrm_user
2024-12-18T00:09:58.9441025Z xt_addrtype            16384  2
2024-12-18T00:09:58.9441403Z nft_compat             20480  4
2024-12-18T00:09:58.9441864Z nf_tables             311296  57 nft_compat,nft_chain_nat
2024-12-18T00:09:58.9442421Z nfnetlink              20480  4 nft_compat,nf_conntrack_netlink,nf_tables
2024-12-18T00:09:58.9442947Z br_netfilter           36864  0
2024-12-18T00:09:58.9443347Z bridge                323584  1 br_netfilter
2024-12-18T00:09:58.9443771Z stp                    16384  1 bridge
2024-12-18T00:09:58.9444856Z llc                    16384  2 bridge,stp
2024-12-18T00:09:58.9445279Z overlay               167936  0
2024-12-18T00:09:58.9445647Z tls                   114688  0
2024-12-18T00:09:58.9446016Z nls_ascii              16384  1
2024-12-18T00:09:58.9446384Z nls_cp437              20480  1
2024-12-18T00:09:58.9446752Z vfat                   24576  1
2024-12-18T00:09:58.9447099Z sunrpc                692224  1
2024-12-18T00:09:58.9447467Z ata_piix               45056  0
2024-12-18T00:09:58.9447838Z fat                    86016  1 vfat
2024-12-18T00:09:58.9448240Z libata                401408  1 ata_piix
2024-12-18T00:09:58.9448652Z scsi_mod              290816  1 libata
2024-12-18T00:09:58.9449022Z ena                   167936  0
2024-12-18T00:09:58.9449431Z scsi_common            16384  2 scsi_mod,libata
2024-12-18T00:09:58.9449867Z ghash_clmulni_intel    16384  0
2024-12-18T00:09:58.9450239Z i8042                  45056  0
2024-12-18T00:09:58.9450600Z serio                  28672  3 i8042
2024-12-18T00:09:58.9451000Z button                 24576  0
2024-12-18T00:09:58.9451367Z sch_fq_codel           20480  9
2024-12-18T00:09:58.9451730Z dm_mod                188416  0
2024-12-18T00:09:58.9452085Z fuse                  163840  1
2024-12-18T00:09:58.9452427Z configfs               57344  1
2024-12-18T00:09:58.9452794Z loop                   36864  0
2024-12-18T00:09:58.9453164Z dax                    45056  1 dm_mod
2024-12-18T00:09:58.9453557Z dmi_sysfs              20480  0
2024-12-18T00:09:58.9453927Z crc32_pclmul           16384  0
2024-12-18T00:09:58.9454280Z crc32c_intel           24576  0
2024-12-18T00:09:58.9454646Z + modinfo nvidia
2024-12-18T00:09:58.9455214Z filename:       /lib/modules/6.1.109-118.189.amzn2023.x86_64/kernel/drivers/video/nvidia.ko
2024-12-18T00:09:58.9455839Z alias:          char-major-195-*
2024-12-18T00:09:58.9456696Z version:        550.54.15
2024-12-18T00:09:58.9457059Z supported:      external
2024-12-18T00:09:58.9457404Z license:        NVIDIA
2024-12-18T00:09:58.9457814Z firmware:       nvidia/550.54.15/gsp_tu10x.bin
2024-12-18T00:09:58.9458297Z firmware:       nvidia/550.54.15/gsp_ga10x.bin
2024-12-18T00:09:58.9458752Z srcversion:     833721318DA517F0C2FEC97
2024-12-18T00:09:58.9459203Z alias:          pci:v000010DEd*sv*sd*bc06sc80i00*
2024-12-18T00:09:58.9459664Z alias:          pci:v000010DEd*sv*sd*bc03sc02i00*
2024-12-18T00:09:58.9460147Z alias:          pci:v000010DEd*sv*sd*bc03sc00i00*
2024-12-18T00:09:58.9460591Z depends:        i2c-core,drm
2024-12-18T00:09:58.9460966Z retpoline:      Y
2024-12-18T00:09:58.9461293Z name:           nvidia
2024-12-18T00:09:58.9461784Z vermagic:       6.1.109-118.189.amzn2023.x86_64 SMP preempt mod_unload modversions 
2024-12-18T00:09:58.9462433Z parm:           NvSwitchRegDwords:NvSwitch regkey (charp)
2024-12-18T00:09:58.9463050Z parm:           NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp)
2024-12-18T00:09:58.9463634Z parm:           NVreg_ResmanDebugLevel:int
2024-12-18T00:09:58.9464084Z parm:           NVreg_RmLogonRC:int
2024-12-18T00:09:58.9464507Z parm:           NVreg_ModifyDeviceFiles:int
2024-12-18T00:09:58.9464963Z parm:           NVreg_DeviceFileUID:int
2024-12-18T00:09:58.9465395Z parm:           NVreg_DeviceFileGID:int
2024-12-18T00:09:58.9465831Z parm:           NVreg_DeviceFileMode:int
2024-12-18T00:09:58.9466339Z parm:           NVreg_InitializeSystemMemoryAllocations:int
2024-12-18T00:09:58.9466877Z parm:           NVreg_UsePageAttributeTable:int
2024-12-18T00:09:58.9467331Z parm:           NVreg_EnablePCIeGen3:int
2024-12-18T00:09:58.9467767Z parm:           NVreg_EnableMSI:int
2024-12-18T00:09:58.9468188Z parm:           NVreg_TCEBypassMode:int
2024-12-18T00:09:58.9468640Z parm:           NVreg_EnableStreamMemOPs:int
2024-12-18T00:09:58.9469151Z parm:           NVreg_RestrictProfilingToAdminUsers:int
2024-12-18T00:09:58.9469680Z parm:           NVreg_PreserveVideoMemoryAllocations:int
2024-12-18T00:09:58.9470206Z parm:           NVreg_EnableS0ixPowerManagement:int
2024-12-18T00:09:58.9471096Z parm:           NVreg_S0ixPowerManagementVideoMemoryThreshold:int
2024-12-18T00:09:58.9471686Z parm:           NVreg_DynamicPowerManagement:int
2024-12-18T00:09:58.9472264Z parm:           NVreg_DynamicPowerManagementVideoMemoryThreshold:int
2024-12-18T00:09:58.9472811Z parm:           NVreg_EnableGpuFirmware:int
2024-12-18T00:09:58.9473286Z parm:           NVreg_EnableGpuFirmwareLogs:int
2024-12-18T00:09:58.9474009Z parm:           NVreg_OpenRmEnableUnsupportedGpus:int
2024-12-18T00:09:58.9474555Z parm:           NVreg_EnableUserNUMAManagement:int
2024-12-18T00:09:58.9475036Z parm:           NVreg_MemoryPoolSize:int
2024-12-18T00:09:58.9475472Z parm:           NVreg_KMallocHeapMaxSize:int
2024-12-18T00:09:58.9475946Z parm:           NVreg_VMallocHeapMaxSize:int
2024-12-18T00:09:58.9476409Z parm:           NVreg_IgnoreMMIOCheck:int
2024-12-18T00:09:58.9476854Z parm:           NVreg_NvLinkDisable:int
2024-12-18T00:09:58.9477340Z parm:           NVreg_EnablePCIERelaxedOrderingMode:int
2024-12-18T00:09:58.9477848Z parm:           NVreg_RegisterPCIDriver:int
2024-12-18T00:09:58.9478318Z parm:           NVreg_EnableResizableBar:int
2024-12-18T00:09:58.9478792Z parm:           NVreg_EnableDbgBreakpoint:int
2024-12-18T00:09:58.9479274Z parm:           NVreg_EnableNonblockingOpen:int
2024-12-18T00:09:58.9479749Z parm:           NVreg_RegistryDwords:charp
2024-12-18T00:09:58.9480210Z parm:           NVreg_RegistryDwordsPerDevice:charp
2024-12-18T00:09:58.9480875Z parm:           NVreg_RmMsg:charp
2024-12-18T00:09:58.9481305Z parm:           NVreg_GpuBlacklist:charp
2024-12-18T00:09:58.9481813Z parm:           NVreg_TemporaryFilePath:charp
2024-12-18T00:09:58.9482287Z parm:           NVreg_ExcludedGpus:charp
2024-12-18T00:09:58.9482737Z parm:           NVreg_DmaRemapPeerMmio:int
2024-12-18T00:09:58.9483188Z parm:           NVreg_RmNvlinkBandwidth:charp
2024-12-18T00:09:58.9483655Z parm:           NVreg_ImexChannelCount:int
2024-12-18T00:09:58.9484102Z parm:           rm_firmware_active:charp
2024-12-18T00:09:58.9484521Z + set +e
2024-12-18T00:09:58.9484808Z + nvidia-smi
2024-12-18T00:09:58.9665779Z Wed Dec 18 00:09:58 2024       
2024-12-18T00:09:58.9666348Z +-----------------------------------------------------------------------------------------+
2024-12-18T00:09:58.9667040Z | NVIDIA-SMI 550.54.15              Driver Version: 550.54.15      CUDA Version: 12.4     |
2024-12-18T00:09:58.9667721Z |-----------------------------------------+------------------------+----------------------+
2024-12-18T00:09:58.9668414Z | GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
2024-12-18T00:09:58.9669146Z | Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
2024-12-18T00:09:58.9669735Z |                                         |                        |               MIG M. |
2024-12-18T00:09:58.9670216Z |=========================================+========================+======================|
2024-12-18T00:09:58.9751913Z |   0  Tesla M60                      On  |   00000000:00:1E.0 Off |                    0 |
2024-12-18T00:09:58.9752580Z | N/A   22C    P8             14W /  150W |       0MiB /   7680MiB |      0%      Default |
2024-12-18T00:09:58.9753130Z |                                         |                        |                  N/A |
2024-12-18T00:09:58.9753692Z +-----------------------------------------+------------------------+----------------------+
2024-12-18T00:09:58.9754248Z                                                                                          
2024-12-18T00:09:58.9754780Z +-----------------------------------------------------------------------------------------+
2024-12-18T00:09:58.9755383Z | Processes:                                                                              |
2024-12-18T00:09:58.9756443Z |  GPU   GI   CI        PID   Type   Process name                              GPU Memory |
2024-12-18T00:09:58.9757184Z |        ID   ID                                                               Usage      |
2024-12-18T00:09:58.9758209Z |=========================================================================================|
2024-12-18T00:09:58.9758830Z |  No running processes found                                                             |
2024-12-18T00:09:58.9759460Z +-----------------------------------------------------------------------------------------+
2024-12-18T00:09:59.0361454Z + nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0
2024-12-18T00:09:59.0556455Z Tesla M60
2024-12-18T00:09:59.0627192Z + NVIDIA_SMI_STATUS=0
2024-12-18T00:09:59.0627586Z + '[' 0 -eq 0 ']'
2024-12-18T00:09:59.0627946Z + echo 'INFO: Ignoring allowed status 0'
2024-12-18T00:09:59.0628363Z + set -e
2024-12-18T00:09:59.0628684Z INFO: Ignoring allowed status 0
2024-12-18T00:09:59.0635534Z == Installing nvidia container toolkit for amzn2023 ==
2024-12-18T00:09:59.0639719Z + sudo yum install -y yum-utils
2024-12-18T00:09:59.6536547Z Last metadata expiration check: 0:19:53 ago on Tue Dec 17 23:50:06 2024.
2024-12-18T00:09:59.6859121Z Package dnf-utils-4.3.0-13.amzn2023.0.4.noarch is already installed.
2024-12-18T00:09:59.7344918Z Dependencies resolved.
2024-12-18T00:09:59.7563549Z Nothing to do.
2024-12-18T00:09:59.7564677Z Complete!
2024-12-18T00:09:59.8947711Z + [[ amzn2023 == \a\m\z\n\2\0\2\3 ]]
2024-12-18T00:09:59.8948636Z + YUM_REPO_URL=https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo
2024-12-18T00:09:59.8949789Z + sudo yum-config-manager --add-repo https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo
2024-12-18T00:10:00.2474549Z Adding repo from: https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo
2024-12-18T00:10:00.3379985Z + sudo yum install -y nvidia-docker2 nvidia-container-toolkit-1.16.2
2024-12-18T00:10:01.0013938Z nvidia-container-toolkit                        8.3 kB/s | 833  B     00:00    
2024-12-18T00:10:01.0333792Z Package nvidia-docker2-2.14.0-1.noarch is already installed.
2024-12-18T00:10:01.0340730Z Package nvidia-container-toolkit-1.16.2-1.x86_64 is already installed.
2024-12-18T00:10:01.0807304Z Dependencies resolved.
2024-12-18T00:10:01.1025379Z Nothing to do.
2024-12-18T00:10:01.1025752Z Complete!
2024-12-18T00:10:01.2350024Z + sudo systemctl restart docker
2024-12-18T00:10:40.5935385Z nvidia-persistenced failed to initialize. Check syslog for more details.
2024-12-18T00:10:40.6167156Z Wed Dec 18 00:10:40 2024       
2024-12-18T00:10:40.6169988Z +-----------------------------------------------------------------------------------------+
2024-12-18T00:10:40.6171196Z | NVIDIA-SMI 550.54.15              Driver Version: 550.54.15      CUDA Version: 12.4     |
2024-12-18T00:10:40.6172330Z |-----------------------------------------+------------------------+----------------------+
2024-12-18T00:10:40.6173485Z | GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
2024-12-18T00:10:40.6174726Z | Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
2024-12-18T00:10:40.6175821Z |                                         |                        |               MIG M. |
2024-12-18T00:10:40.6176604Z |=========================================+========================+======================|
2024-12-18T00:10:40.6252241Z |   0  Tesla M60                      On  |   00000000:00:1E.0 Off |                    0 |
2024-12-18T00:10:40.6253281Z | N/A   22C    P8             14W /  150W |       0MiB /   7680MiB |      0%      Default |
2024-12-18T00:10:40.6254166Z |                                         |                        |                  N/A |
2024-12-18T00:10:40.6255101Z +-----------------------------------------+------------------------+----------------------+
2024-12-18T00:10:40.6256375Z                                                                                          
2024-12-18T00:10:40.6257314Z +-----------------------------------------------------------------------------------------+
2024-12-18T00:10:40.6259001Z | Processes:                                                                              |
2024-12-18T00:10:40.6260078Z |  GPU   GI   CI        PID   Type   Process name                              GPU Memory |
2024-12-18T00:10:40.6261042Z |        ID   ID                                                               Usage      |
2024-12-18T00:10:40.6261856Z |=========================================================================================|
2024-12-18T00:10:40.6262839Z |  No running processes found                                                             |
2024-12-18T00:10:40.6263947Z +-----------------------------------------------------------------------------------------+
2024-12-18T00:10:40.9996767Z Command completed after 1 attempt(s).
2024-12-18T00:10:41.0096400Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84
2024-12-18T00:10:41.0097262Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84
2024-12-18T00:10:41.0097971Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 &
2024-12-18T00:10:41.0098671Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}"
2024-12-18T00:10:41.0110368Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:10:41.0110903Z env:
2024-12-18T00:10:41.0111213Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:10:41.0111695Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:10:41.0112203Z ##[endgroup]
2024-12-18T00:10:41.3587927Z Defaulting to user installation because normal site-packages is not writeable
2024-12-18T00:10:41.3803206Z Requirement already satisfied: psutil==5.9.1 in /home/ec2-user/.local/lib/python3.9/site-packages (5.9.1)
2024-12-18T00:10:41.3811262Z Requirement already satisfied: nvidia-ml-py==11.525.84 in /home/ec2-user/.local/lib/python3.9/site-packages (11.525.84)
2024-12-18T00:10:41.5611807Z Prepare all required actions
2024-12-18T00:10:41.5613057Z Getting action download info
2024-12-18T00:10:41.7074133Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6)
2024-12-18T00:10:45.1460670Z Download action repository 'actions/download-artifact@v4' (SHA:fa0a91b85d4f404e444e00e005971372dc801d16)
2024-12-18T00:10:45.4762741Z ##[group]Run ./.github/actions/download-build-artifacts
2024-12-18T00:10:45.4763266Z with:
2024-12-18T00:10:45.4763648Z   name: linux-focal-cuda11.8-py3.10-gcc9-debug
2024-12-18T00:10:45.4764211Z   s3-bucket: gha-artifacts
2024-12-18T00:10:45.4764573Z env:
2024-12-18T00:10:45.4764850Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:10:45.4765300Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:10:45.4765774Z ##[endgroup]
2024-12-18T00:10:45.4813838Z ##[group]Run seemethere/download-artifact-s3@v4
2024-12-18T00:10:45.4814321Z with:
2024-12-18T00:10:45.4814757Z   name: linux-focal-cuda11.8-py3.10-gcc9-debug
2024-12-18T00:10:45.4815261Z   s3-bucket: gha-artifacts
2024-12-18T00:10:45.4815633Z   region: us-east-1
2024-12-18T00:10:45.4815969Z env:
2024-12-18T00:10:45.4816269Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:10:45.4816768Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:10:45.4817276Z ##[endgroup]
2024-12-18T00:10:46.1102234Z (node:123562) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023.
2024-12-18T00:10:46.1102865Z 
2024-12-18T00:10:46.1103154Z Please migrate your code to use AWS SDK for JavaScript (v3).
2024-12-18T00:10:46.1103829Z For more information, check the migration guide at https://a.co/7PzMCcy
2024-12-18T00:10:46.1104541Z (Use `node --trace-warnings ...` to show where the warning was created)
2024-12-18T00:10:46.2491215Z Found 1 objects with prefix pytorch/pytorch/12383255654/linux-focal-cuda11.8-py3.10-gcc9-debug/
2024-12-18T00:10:46.2492272Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip
2024-12-18T00:10:54.5989413Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip
2024-12-18T00:10:54.5998574Z Artifact download has finished successfully
2024-12-18T00:10:54.6262742Z ##[group]Run unzip -o artifacts.zip
2024-12-18T00:10:54.6263232Z unzip -o artifacts.zip
2024-12-18T00:10:54.6270577Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:10:54.6271097Z env:
2024-12-18T00:10:54.6271413Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:10:54.6271901Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:10:54.6272412Z ##[endgroup]
2024-12-18T00:10:54.6321874Z Archive:  artifacts.zip
2024-12-18T00:10:54.6323685Z    creating: dist/
2024-12-18T00:10:57.3508890Z   inflating: dist/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl  
2024-12-18T00:10:57.3509561Z    creating: build/custom_test_artifacts/
2024-12-18T00:10:57.3510109Z    creating: build/custom_test_artifacts/custom-op-build/
2024-12-18T00:10:57.3510739Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/
2024-12-18T00:10:57.3511494Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/
2024-12-18T00:10:57.3519873Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml  
2024-12-18T00:10:57.3520730Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/
2024-12-18T00:10:57.3521567Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeSystem.cmake  
2024-12-18T00:10:57.3522426Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/
2024-12-18T00:10:57.3523298Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/tmp/
2024-12-18T00:10:57.3524669Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c  
2024-12-18T00:10:57.3527698Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/a.out  
2024-12-18T00:10:57.3528639Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/
2024-12-18T00:10:57.3529524Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/
2024-12-18T00:10:57.3530618Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp  
2024-12-18T00:10:57.3533400Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out  
2024-12-18T00:10:57.3534856Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin  
2024-12-18T00:10:57.3535907Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake  
2024-12-18T00:10:57.3538717Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin  
2024-12-18T00:10:57.3539830Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake  
2024-12-18T00:10:57.3540771Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/
2024-12-18T00:10:57.3541740Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/
2024-12-18T00:10:57.3597715Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii  
2024-12-18T00:10:57.3599010Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c  
2024-12-18T00:10:57.3600452Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu  
2024-12-18T00:10:57.3601789Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c  
2024-12-18T00:10:57.3603098Z  extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id  
2024-12-18T00:10:57.3604339Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx  
2024-12-18T00:10:57.3606007Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin  
2024-12-18T00:10:57.3607632Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin  
2024-12-18T00:10:57.3608888Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c  
2024-12-18T00:10:57.3653596Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii  
2024-12-18T00:10:57.3701760Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp  
2024-12-18T00:10:57.3703182Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o  
2024-12-18T00:10:57.3704540Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin  
2024-12-18T00:10:57.3705875Z  extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c  
2024-12-18T00:10:57.3707177Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin  
2024-12-18T00:10:57.3708473Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c  
2024-12-18T00:10:57.3709746Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o  
2024-12-18T00:10:57.3711197Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu  
2024-12-18T00:10:57.3785279Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out  
2024-12-18T00:10:57.3859072Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin  
2024-12-18T00:10:57.3860511Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake  
2024-12-18T00:10:57.3861441Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/
2024-12-18T00:10:57.3862221Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeTmp/
2024-12-18T00:10:57.3863235Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache  
2024-12-18T00:10:57.3864274Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/
2024-12-18T00:10:57.3865212Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts  
2024-12-18T00:10:57.3866413Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make  
2024-12-18T00:10:57.3867442Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make  
2024-12-18T00:10:57.3868553Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt  
2024-12-18T00:10:57.3869535Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake  
2024-12-18T00:10:57.3870515Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make  
2024-12-18T00:10:57.3871497Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake  
2024-12-18T00:10:57.3872676Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make  
2024-12-18T00:10:57.3873639Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make  
2024-12-18T00:10:57.3897093Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d  
2024-12-18T00:10:57.4071275Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o  
2024-12-18T00:10:57.4072197Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/
2024-12-18T00:10:57.4073614Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts  
2024-12-18T00:10:57.4074715Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make  
2024-12-18T00:10:57.4075756Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make  
2024-12-18T00:10:57.4076745Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt  
2024-12-18T00:10:57.4077754Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake  
2024-12-18T00:10:57.4078957Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make  
2024-12-18T00:10:57.4079980Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake  
2024-12-18T00:10:57.4081012Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make  
2024-12-18T00:10:57.4082016Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make  
2024-12-18T00:10:57.4105199Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d  
2024-12-18T00:10:57.4205338Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o  
2024-12-18T00:10:57.4206434Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake  
2024-12-18T00:10:57.4207421Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt  
2024-12-18T00:10:57.4208517Z  extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks  
2024-12-18T00:10:57.4209382Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2  
2024-12-18T00:10:57.4210911Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake  
2024-12-18T00:10:57.4211760Z   inflating: build/custom_test_artifacts/custom-op-build/detect_cuda_version.cc  
2024-12-18T00:10:57.4215303Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt  
2024-12-18T00:10:57.4216424Z   inflating: build/custom_test_artifacts/custom-op-build/Makefile  
2024-12-18T00:10:57.4217396Z   inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake  
2024-12-18T00:10:57.4363474Z   inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so  
2024-12-18T00:10:57.4439167Z   inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops  
2024-12-18T00:10:57.4439831Z    creating: build/custom_test_artifacts/jit-hook-build/
2024-12-18T00:10:57.4440460Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/
2024-12-18T00:10:57.4441194Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/
2024-12-18T00:10:57.4449232Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml  
2024-12-18T00:10:57.4450050Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/
2024-12-18T00:10:57.4450883Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeSystem.cmake  
2024-12-18T00:10:57.4451768Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/
2024-12-18T00:10:57.4452623Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/tmp/
2024-12-18T00:10:57.4454238Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c  
2024-12-18T00:10:57.4456630Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/a.out  
2024-12-18T00:10:57.4457536Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/
2024-12-18T00:10:57.4458492Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/
2024-12-18T00:10:57.4460719Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp  
2024-12-18T00:10:57.4462934Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out  
2024-12-18T00:10:57.4465267Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin  
2024-12-18T00:10:57.4466599Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake  
2024-12-18T00:10:57.4468392Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin  
2024-12-18T00:10:57.4469983Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake  
2024-12-18T00:10:57.4470921Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/
2024-12-18T00:10:57.4471886Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/
2024-12-18T00:10:57.4526716Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii  
2024-12-18T00:10:57.4527951Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c  
2024-12-18T00:10:57.4529221Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu  
2024-12-18T00:10:57.4530526Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c  
2024-12-18T00:10:57.4531837Z  extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id  
2024-12-18T00:10:57.4533300Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx  
2024-12-18T00:10:57.4534564Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin  
2024-12-18T00:10:57.4535815Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin  
2024-12-18T00:10:57.4537032Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c  
2024-12-18T00:10:57.4584117Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii  
2024-12-18T00:10:57.4631740Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp  
2024-12-18T00:10:57.4633217Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o  
2024-12-18T00:10:57.4634549Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin  
2024-12-18T00:10:57.4635698Z  extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c  
2024-12-18T00:10:57.4636795Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin  
2024-12-18T00:10:57.4637892Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c  
2024-12-18T00:10:57.4638957Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o  
2024-12-18T00:10:57.4640536Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu  
2024-12-18T00:10:57.4714818Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out  
2024-12-18T00:10:57.4788955Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin  
2024-12-18T00:10:57.4790024Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake  
2024-12-18T00:10:57.4791136Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/
2024-12-18T00:10:57.4791917Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeTmp/
2024-12-18T00:10:57.4792712Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache  
2024-12-18T00:10:57.4793539Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/
2024-12-18T00:10:57.4794504Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts  
2024-12-18T00:10:57.4795570Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make  
2024-12-18T00:10:57.4796612Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make  
2024-12-18T00:10:57.4797573Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt  
2024-12-18T00:10:57.4798586Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake  
2024-12-18T00:10:57.4799593Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make  
2024-12-18T00:10:57.4800597Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake  
2024-12-18T00:10:57.4801575Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make  
2024-12-18T00:10:57.4802585Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make  
2024-12-18T00:10:57.4825758Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d  
2024-12-18T00:10:57.4903423Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o  
2024-12-18T00:10:57.4904525Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake  
2024-12-18T00:10:57.4905511Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt  
2024-12-18T00:10:57.4906395Z  extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks  
2024-12-18T00:10:57.4907191Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2  
2024-12-18T00:10:57.4908379Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake  
2024-12-18T00:10:57.4909196Z   inflating: build/custom_test_artifacts/jit-hook-build/detect_cuda_version.cc  
2024-12-18T00:10:57.4912707Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt  
2024-12-18T00:10:57.4913632Z   inflating: build/custom_test_artifacts/jit-hook-build/Makefile  
2024-12-18T00:10:57.4914628Z   inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake  
2024-12-18T00:10:57.4974832Z   inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks  
2024-12-18T00:10:57.4975544Z    creating: build/custom_test_artifacts/custom-backend-build/
2024-12-18T00:10:57.4976268Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/
2024-12-18T00:10:57.4977135Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/
2024-12-18T00:10:57.4985014Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml  
2024-12-18T00:10:57.4985923Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/
2024-12-18T00:10:57.4986820Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeSystem.cmake  
2024-12-18T00:10:57.4987767Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/
2024-12-18T00:10:57.4988753Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/tmp/
2024-12-18T00:10:57.4990126Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c  
2024-12-18T00:10:57.4992657Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/a.out  
2024-12-18T00:10:57.4993646Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/
2024-12-18T00:10:57.4994615Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/
2024-12-18T00:10:57.4996183Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp  
2024-12-18T00:10:57.4998592Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out  
2024-12-18T00:10:57.5000397Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin  
2024-12-18T00:10:57.5001696Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake  
2024-12-18T00:10:57.5003545Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin  
2024-12-18T00:10:57.5005123Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake  
2024-12-18T00:10:57.5006122Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/
2024-12-18T00:10:57.5007091Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/
2024-12-18T00:10:57.5062567Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii  
2024-12-18T00:10:57.5064119Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c  
2024-12-18T00:10:57.5065899Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu  
2024-12-18T00:10:57.5067306Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c  
2024-12-18T00:10:57.5068920Z  extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id  
2024-12-18T00:10:57.5070231Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx  
2024-12-18T00:10:57.5071528Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin  
2024-12-18T00:10:57.5072845Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin  
2024-12-18T00:10:57.5074143Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c  
2024-12-18T00:10:57.5118325Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii  
2024-12-18T00:10:57.5166772Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp  
2024-12-18T00:10:57.5168318Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o  
2024-12-18T00:10:57.5169754Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin  
2024-12-18T00:10:57.5171132Z  extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c  
2024-12-18T00:10:57.5172317Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin  
2024-12-18T00:10:57.5173683Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c  
2024-12-18T00:10:57.5174867Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o  
2024-12-18T00:10:57.5176363Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu  
2024-12-18T00:10:57.5249425Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out  
2024-12-18T00:10:57.5323483Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin  
2024-12-18T00:10:57.5324631Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake  
2024-12-18T00:10:57.5325592Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/
2024-12-18T00:10:57.5326508Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeTmp/
2024-12-18T00:10:57.5327642Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache  
2024-12-18T00:10:57.5328536Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/
2024-12-18T00:10:57.5329676Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts  
2024-12-18T00:10:57.5331064Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make  
2024-12-18T00:10:57.5332183Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make  
2024-12-18T00:10:57.5333221Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt  
2024-12-18T00:10:57.5334296Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake  
2024-12-18T00:10:57.5335743Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make  
2024-12-18T00:10:57.5336840Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake  
2024-12-18T00:10:57.5337924Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make  
2024-12-18T00:10:57.5338990Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make  
2024-12-18T00:10:57.5340323Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d  
2024-12-18T00:10:57.5487830Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o  
2024-12-18T00:10:57.5488996Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/
2024-12-18T00:10:57.5490257Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts  
2024-12-18T00:10:57.5491588Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make  
2024-12-18T00:10:57.5492857Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make  
2024-12-18T00:10:57.5494045Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt  
2024-12-18T00:10:57.5495271Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake  
2024-12-18T00:10:57.5496662Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make  
2024-12-18T00:10:57.5497812Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake  
2024-12-18T00:10:57.5498945Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make  
2024-12-18T00:10:57.5500072Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make  
2024-12-18T00:10:57.5521494Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d  
2024-12-18T00:10:57.5588413Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o  
2024-12-18T00:10:57.5589831Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake  
2024-12-18T00:10:57.5590884Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt  
2024-12-18T00:10:57.5591889Z  extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks  
2024-12-18T00:10:57.5592893Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2  
2024-12-18T00:10:57.5594010Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake  
2024-12-18T00:10:57.5594927Z   inflating: build/custom_test_artifacts/custom-backend-build/detect_cuda_version.cc  
2024-12-18T00:10:57.5598116Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt  
2024-12-18T00:10:57.5599356Z   inflating: build/custom_test_artifacts/custom-backend-build/Makefile  
2024-12-18T00:10:57.5600554Z   inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake  
2024-12-18T00:10:57.5723140Z   inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so  
2024-12-18T00:10:57.5775040Z   inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend  
2024-12-18T00:10:57.5775658Z    creating: build/lib/
2024-12-18T00:10:57.5789878Z   inflating: build/lib/libpthreadpool.a  
2024-12-18T00:10:57.5799703Z   inflating: build/lib/libcpuinfo_internals.a  
2024-12-18T00:10:57.5809858Z   inflating: build/lib/libcpuinfo.a  
2024-12-18T00:10:57.5811062Z   inflating: build/lib/libclog.a     
2024-12-18T00:10:57.5952035Z   inflating: build/lib/libprotobuf-lite.a  
2024-12-18T00:10:57.5954625Z   inflating: build/lib/libnnpack_reference_layers.a  
2024-12-18T00:10:57.6585214Z   inflating: build/lib/libprotobuf.a  
2024-12-18T00:10:57.6608070Z   inflating: build/lib/libnnpack.a   
2024-12-18T00:10:57.6691241Z   inflating: build/lib/libgtest.a    
2024-12-18T00:10:57.6788718Z   inflating: build/lib/libbenchmark.a  
2024-12-18T00:10:57.6798054Z   inflating: build/lib/libittnotify.a  
2024-12-18T00:10:57.6886865Z   inflating: build/lib/libasmjit.a   
2024-12-18T00:10:57.6924342Z   inflating: build/lib/libtensorpipe_uv.a  
2024-12-18T00:10:57.7078655Z   inflating: build/lib/libgloo.a     
2024-12-18T00:10:57.7426654Z   inflating: build/lib/libmicrokernels-prod.a  
2024-12-18T00:10:57.7452128Z   inflating: build/lib/libfmt.a      
2024-12-18T00:10:57.7454378Z   inflating: build/lib/libcaffe2_nvrtc.so  
2024-12-18T00:10:57.7582664Z   inflating: build/lib/libc10.so     
2024-12-18T00:10:57.7584445Z   inflating: build/lib/libtorch_global_deps.so  
2024-12-18T00:10:57.7610269Z   inflating: build/lib/libpytorch_qnnpack.a  
2024-12-18T00:10:57.8225881Z   inflating: build/lib/libprotoc.a   
2024-12-18T00:10:57.8246843Z   inflating: build/lib/libgmock.a    
2024-12-18T00:10:57.8247768Z   inflating: build/lib/libgtest_main.a  
2024-12-18T00:10:57.8248948Z   inflating: build/lib/libbenchmark_main.a  
2024-12-18T00:10:59.0535286Z   inflating: build/lib/libdnnl.a     
2024-12-18T00:10:59.1288619Z   inflating: build/lib/libtensorpipe.a  
2024-12-18T00:10:59.1362044Z   inflating: build/lib/libc10_cuda.so  
2024-12-18T00:10:59.3017332Z   inflating: build/lib/libfbgemm.a   
2024-12-18T00:10:59.3018282Z   inflating: build/lib/libgmock_main.a  
2024-12-18T00:10:59.3641101Z   inflating: build/lib/libkineto.a   
2024-12-18T00:10:59.4201338Z   inflating: build/lib/libgloo_cuda.a  
2024-12-18T00:10:59.4532891Z   inflating: build/lib/libtensorpipe_cuda.a  
2024-12-18T00:10:59.4665911Z   inflating: build/lib/libXNNPACK.a  
2024-12-18T00:10:59.4737539Z   inflating: build/lib/libonnx_proto.a  
2024-12-18T00:10:59.5653546Z   inflating: build/lib/libonnx.a     
2024-12-18T00:11:02.6663035Z   inflating: build/lib/libtorch_cpu.so  
2024-12-18T00:11:02.8208540Z   inflating: build/lib/libmicrokernels-all.a  
2024-12-18T00:11:02.8213943Z   inflating: build/lib/libshm.so     
2024-12-18T00:11:02.8221527Z   inflating: build/lib/libunbox_lib.a  
2024-12-18T00:11:06.1261407Z   inflating: build/lib/libtorch_cuda.so  
2024-12-18T00:11:06.1263238Z   inflating: build/lib/libtorch.so   
2024-12-18T00:11:06.1272250Z   inflating: build/lib/libc10d_cuda_test.so  
2024-12-18T00:11:07.2537092Z   inflating: build/lib/libtorch_cuda_linalg.so  
2024-12-18T00:11:07.2564337Z   inflating: build/lib/libjitbackend_test.so  
2024-12-18T00:11:07.2653533Z   inflating: build/lib/libtorchbind_test.so  
2024-12-18T00:11:07.2686300Z   inflating: build/lib/libaoti_custom_ops.so  
2024-12-18T00:11:07.2720304Z   inflating: build/lib/libbackend_with_compiler.so  
2024-12-18T00:11:07.5365136Z   inflating: build/lib/libtorch_python.so  
2024-12-18T00:11:07.5410939Z   inflating: build/lib/libnnapi_backend.so  
2024-12-18T00:11:07.5411417Z    creating: build/bin/
2024-12-18T00:11:07.5477263Z   inflating: build/bin/c10_CompileTimeFunctionPointer_test  
2024-12-18T00:11:07.5544868Z   inflating: build/bin/c10_DeviceGuard_test  
2024-12-18T00:11:07.5612430Z   inflating: build/bin/c10_Device_test  
2024-12-18T00:11:07.5688471Z   inflating: build/bin/c10_DispatchKeySet_test  
2024-12-18T00:11:07.5760732Z   inflating: build/bin/c10_Scalar_test  
2024-12-18T00:11:07.5824175Z   inflating: build/bin/c10_StreamGuard_test  
2024-12-18T00:11:07.5893503Z   inflating: build/bin/c10_SymInt_test  
2024-12-18T00:11:07.5965982Z   inflating: build/bin/c10_InlineDeviceGuard_test  
2024-12-18T00:11:07.6039665Z   inflating: build/bin/c10_InlineStreamGuard_test  
2024-12-18T00:11:07.6112500Z   inflating: build/bin/c10_SizesAndStrides_test  
2024-12-18T00:11:07.6204858Z   inflating: build/bin/c10_cow_test  
2024-12-18T00:11:07.6269988Z   inflating: build/bin/c10_ArrayRef_test  
2024-12-18T00:11:07.6333063Z   inflating: build/bin/c10_ConstexprCrc_test  
2024-12-18T00:11:07.6401934Z   inflating: build/bin/c10_Bitset_test  
2024-12-18T00:11:07.6467126Z   inflating: build/bin/c10_DeadlockDetection_test  
2024-12-18T00:11:07.6533031Z   inflating: build/bin/c10_Half_test  
2024-12-18T00:11:07.6606073Z   inflating: build/bin/c10_LeftRight_test  
2024-12-18T00:11:07.6677208Z   inflating: build/bin/c10_Metaprogramming_test  
2024-12-18T00:11:07.6745611Z   inflating: build/bin/c10_NetworkFlow_test  
2024-12-18T00:11:07.6811089Z   inflating: build/bin/c10_Synchronized_test  
2024-12-18T00:11:07.6882942Z   inflating: build/bin/c10_ThreadLocal_test  
2024-12-18T00:11:07.6949713Z   inflating: build/bin/c10_TypeIndex_test  
2024-12-18T00:11:07.7016593Z   inflating: build/bin/c10_TypeList_test  
2024-12-18T00:11:07.7080192Z   inflating: build/bin/c10_TypeTraits_test  
2024-12-18T00:11:07.7152430Z   inflating: build/bin/c10_bfloat16_test  
2024-12-18T00:11:07.7220126Z   inflating: build/bin/c10_accumulate_test  
2024-12-18T00:11:07.7285935Z   inflating: build/bin/c10_bit_cast_test  
2024-12-18T00:11:07.7359356Z   inflating: build/bin/c10_complex_math_test  
2024-12-18T00:11:07.7430324Z   inflating: build/bin/c10_complex_test  
2024-12-18T00:11:07.7494993Z   inflating: build/bin/c10_error_test  
2024-12-18T00:11:07.7563703Z   inflating: build/bin/c10_exception_test  
2024-12-18T00:11:07.7629345Z   inflating: build/bin/c10_flags_test  
2024-12-18T00:11:07.7695376Z   inflating: build/bin/c10_generic_math_test  
2024-12-18T00:11:07.7906955Z   inflating: build/bin/c10_intrusive_ptr_test  
2024-12-18T00:11:07.7973294Z   inflating: build/bin/c10_irange_test  
2024-12-18T00:11:07.8042322Z   inflating: build/bin/c10_lazy_test  
2024-12-18T00:11:07.8116479Z   inflating: build/bin/c10_logging_test  
2024-12-18T00:11:07.8212876Z   inflating: build/bin/c10_optional_test  
2024-12-18T00:11:07.8293696Z   inflating: build/bin/c10_ordered_preserving_dict_test  
2024-12-18T00:11:07.8362981Z   inflating: build/bin/c10_registry_test  
2024-12-18T00:11:07.8430045Z   inflating: build/bin/c10_ssize_test  
2024-12-18T00:11:07.8627587Z   inflating: build/bin/c10_small_vector_test  
2024-12-18T00:11:07.8695060Z   inflating: build/bin/c10_string_util_test  
2024-12-18T00:11:07.8772035Z   inflating: build/bin/c10_string_view_test  
2024-12-18T00:11:07.8834171Z   inflating: build/bin/c10_intrusive_ptr_benchmark  
2024-12-18T00:11:07.8900044Z   inflating: build/bin/c10_tempfile_test  
2024-12-18T00:11:07.8972697Z   inflating: build/bin/c10_typeid_test  
2024-12-18T00:11:07.9546901Z   inflating: build/bin/protoc-3.13.0.0  
2024-12-18T00:11:08.0120527Z   inflating: build/bin/protoc        
2024-12-18T00:11:08.0198754Z   inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_stream  
2024-12-18T00:11:08.0276459Z   inflating: build/bin/c10_cuda_CUDAAssertionsTest_1_var_test  
2024-12-18T00:11:08.0354074Z   inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_thread_and_block_and_device  
2024-12-18T00:11:08.0432090Z   inflating: build/bin/c10_cuda_CUDAAssertionsTest_from_2_processes  
2024-12-18T00:11:08.0513630Z   inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_blocks_and_threads  
2024-12-18T00:11:08.0577603Z   inflating: build/bin/c10_cuda_CUDATest  
2024-12-18T00:11:08.0655658Z   inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_multiple_blocks  
2024-12-18T00:11:08.0733429Z   inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_same_block  
2024-12-18T00:11:08.1240550Z   inflating: build/bin/vec_test_all_types_DEFAULT  
2024-12-18T00:11:08.1758588Z   inflating: build/bin/vec_test_all_types_AVX512  
2024-12-18T00:11:08.2296824Z   inflating: build/bin/vec_test_all_types_AVX2  
2024-12-18T00:11:08.2366533Z   inflating: build/bin/HashStoreTest  
2024-12-18T00:11:08.2438187Z   inflating: build/bin/TCPStoreTest  
2024-12-18T00:11:08.2506734Z   inflating: build/bin/BackoffTest   
2024-12-18T00:11:08.2576745Z   inflating: build/bin/FileStoreTest  
2024-12-18T00:11:08.2595708Z   inflating: build/bin/ProcessGroupMPITest  
2024-12-18T00:11:08.2601045Z   inflating: build/bin/torch_shm_manager  
2024-12-18T00:11:08.2671923Z   inflating: build/bin/test_edge_op_registration  
2024-12-18T00:11:08.2676836Z   inflating: build/bin/example_allreduce  
2024-12-18T00:11:08.2744259Z   inflating: build/bin/Dimname_test  
2024-12-18T00:11:08.2841571Z   inflating: build/bin/Dict_test     
2024-12-18T00:11:08.2926133Z   inflating: build/bin/MaybeOwned_test  
2024-12-18T00:11:08.3004611Z   inflating: build/bin/apply_utils_test  
2024-12-18T00:11:08.3081258Z   inflating: build/bin/NamedTensor_test  
2024-12-18T00:11:08.3160085Z   inflating: build/bin/atest         
2024-12-18T00:11:08.3242226Z   inflating: build/bin/basic         
2024-12-18T00:11:08.3314183Z   inflating: build/bin/broadcast_test  
2024-12-18T00:11:08.3382126Z   inflating: build/bin/cpu_allocator_test  
2024-12-18T00:11:08.3457786Z   inflating: build/bin/cpu_generator_test  
2024-12-18T00:11:08.3529387Z   inflating: build/bin/cpu_profiling_allocator_test  
2024-12-18T00:11:08.3594825Z   inflating: build/bin/dispatch_key_set_test  
2024-12-18T00:11:08.3662775Z   inflating: build/bin/dlconvertor_test  
2024-12-18T00:11:08.3782092Z   inflating: build/bin/cpu_rng_test  
2024-12-18T00:11:08.3900390Z   inflating: build/bin/extension_backend_test  
2024-12-18T00:11:08.3930852Z   inflating: build/bin/half_test     
2024-12-18T00:11:08.4058375Z   inflating: build/bin/ivalue_test   
2024-12-18T00:11:08.4123227Z   inflating: build/bin/lazy_tensor_test  
2024-12-18T00:11:08.4195123Z   inflating: build/bin/memory_format_test  
2024-12-18T00:11:08.4267141Z   inflating: build/bin/math_kernel_test  
2024-12-18T00:11:08.4335909Z   inflating: build/bin/memory_overlapping_test  
2024-12-18T00:11:08.4405763Z   inflating: build/bin/mobile_memory_cleanup  
2024-12-18T00:11:08.4471862Z   inflating: build/bin/operator_name_test  
2024-12-18T00:11:08.4546081Z   inflating: build/bin/native_test   
2024-12-18T00:11:08.4613671Z   inflating: build/bin/operators_test  
2024-12-18T00:11:08.4682169Z   inflating: build/bin/packedtensoraccessor_test  
2024-12-18T00:11:08.4769949Z   inflating: build/bin/pow_test      
2024-12-18T00:11:08.4845327Z   inflating: build/bin/quantized_test  
2024-12-18T00:11:08.4911813Z   inflating: build/bin/reduce_ops_test  
2024-12-18T00:11:08.4979483Z   inflating: build/bin/reportMemoryUsage_test  
2024-12-18T00:11:08.5054392Z   inflating: build/bin/scalar_tensor_test  
2024-12-18T00:11:08.5123328Z   inflating: build/bin/StorageUtils_test  
2024-12-18T00:11:08.5201808Z   inflating: build/bin/scalar_test   
2024-12-18T00:11:08.5272015Z   inflating: build/bin/stride_properties_test  
2024-12-18T00:11:08.5374140Z   inflating: build/bin/tensor_iterator_test  
2024-12-18T00:11:08.5378590Z   inflating: build/bin/thread_init_test  
2024-12-18T00:11:08.5450885Z   inflating: build/bin/type_ptr_test  
2024-12-18T00:11:08.5524447Z   inflating: build/bin/test_parallel  
2024-12-18T00:11:08.5601845Z   inflating: build/bin/type_test     
2024-12-18T00:11:08.5671332Z   inflating: build/bin/undefined_tensor_test  
2024-12-18T00:11:08.5673320Z   inflating: build/bin/verify_api_visibility  
2024-12-18T00:11:08.5764660Z   inflating: build/bin/legacy_vmap_test  
2024-12-18T00:11:08.5831286Z   inflating: build/bin/weakref_test  
2024-12-18T00:11:08.5899233Z   inflating: build/bin/wrapdim_test  
2024-12-18T00:11:08.5968849Z   inflating: build/bin/xla_tensor_test  
2024-12-18T00:11:08.6046774Z   inflating: build/bin/IListRef_test  
2024-12-18T00:11:08.6185409Z   inflating: build/bin/List_test     
2024-12-18T00:11:08.6342518Z   inflating: build/bin/kernel_function_legacy_test  
2024-12-18T00:11:08.6469363Z   inflating: build/bin/kernel_function_test  
2024-12-18T00:11:08.6557701Z   inflating: build/bin/KernelFunction_test  
2024-12-18T00:11:08.6722882Z   inflating: build/bin/kernel_lambda_legacy_test  
2024-12-18T00:11:08.6857286Z   inflating: build/bin/kernel_lambda_test  
2024-12-18T00:11:08.6938648Z   inflating: build/bin/kernel_stackbased_test  
2024-12-18T00:11:08.7065165Z   inflating: build/bin/make_boxed_from_unboxed_functor_test  
2024-12-18T00:11:08.7131715Z   inflating: build/bin/CppSignature_test  
2024-12-18T00:11:08.7195836Z   inflating: build/bin/op_allowlist_test  
2024-12-18T00:11:08.7577799Z   inflating: build/bin/op_registration_test  
2024-12-18T00:11:08.7659794Z   inflating: build/bin/inline_container_test  
2024-12-18T00:11:08.7733903Z   inflating: build/bin/backend_fallback_test  
2024-12-18T00:11:08.7802663Z   inflating: build/bin/cuda_apply_test  
2024-12-18T00:11:08.7872559Z   inflating: build/bin/cuda_allocator_test  
2024-12-18T00:11:08.7970208Z   inflating: build/bin/cuda_atomic_ops_test  
2024-12-18T00:11:08.8042745Z   inflating: build/bin/cuda_caching_host_allocator_test  
2024-12-18T00:11:08.8170884Z   inflating: build/bin/cuda_complex_math_test  
2024-12-18T00:11:08.8267712Z   inflating: build/bin/cuda_complex_test  
2024-12-18T00:11:08.8332276Z   inflating: build/bin/cuda_device_test  
2024-12-18T00:11:08.8420047Z   inflating: build/bin/cuda_cub_test  
2024-12-18T00:11:08.8486674Z   inflating: build/bin/cuda_dlconvertor_test  
2024-12-18T00:11:08.8569071Z   inflating: build/bin/cuda_integer_divider_test  
2024-12-18T00:11:08.8698275Z   inflating: build/bin/cuda_distributions_test  
2024-12-18T00:11:08.8813662Z   inflating: build/bin/cuda_generator_test  
2024-12-18T00:11:08.8911772Z   inflating: build/bin/cuda_half_test  
2024-12-18T00:11:08.9010320Z   inflating: build/bin/cuda_optional_test  
2024-12-18T00:11:08.9075583Z   inflating: build/bin/cuda_allocatorTraceTracker_test  
2024-12-18T00:11:08.9154390Z   inflating: build/bin/cuda_stream_test  
2024-12-18T00:11:08.9222973Z   inflating: build/bin/cuda_reportMemoryUsage_test  
2024-12-18T00:11:08.9329944Z   inflating: build/bin/cuda_packedtensoraccessor_test  
2024-12-18T00:11:08.9395667Z   inflating: build/bin/cuda_cudnn_test  
2024-12-18T00:11:08.9496258Z   inflating: build/bin/cuda_vectorized_test  
2024-12-18T00:11:08.9583745Z   inflating: build/bin/ProcessGroupGlooTest  
2024-12-18T00:11:08.9603861Z   inflating: build/bin/tutorial_tensorexpr  
2024-12-18T00:11:08.9679139Z   inflating: build/bin/ProcessGroupGlooAsyncTest  
2024-12-18T00:11:08.9763435Z   inflating: build/bin/ProcessGroupNCCLTest  
2024-12-18T00:11:08.9830860Z   inflating: build/bin/ProcessGroupUCCTest  
2024-12-18T00:11:08.9912284Z   inflating: build/bin/ProcessGroupNCCLErrorsTest  
2024-12-18T00:11:08.9985455Z   inflating: build/bin/test_dist_autograd  
2024-12-18T00:11:08.9988805Z   inflating: build/bin/parallel_benchmark  
2024-12-18T00:11:09.0080991Z   inflating: build/bin/test_cpp_rpc  
2024-12-18T00:11:09.0168243Z   inflating: build/bin/test_mobile_nnc  
2024-12-18T00:11:09.0181055Z   inflating: build/bin/aot_model_compiler_test  
2024-12-18T00:11:09.1210872Z   inflating: build/bin/test_tensorexpr  
2024-12-18T00:11:09.1644929Z   inflating: build/bin/test_lazy     
2024-12-18T00:11:09.2369841Z   inflating: build/bin/test_jit      
2024-12-18T00:11:09.3812192Z   inflating: build/bin/test_api      
2024-12-18T00:11:09.3812713Z    creating: .additional_ci_files/
2024-12-18T00:11:09.3921685Z   inflating: .additional_ci_files/test-times.json  
2024-12-18T00:11:09.4356515Z   inflating: .additional_ci_files/test-class-times.json  
2024-12-18T00:11:09.4407242Z ##[group]Run rm artifacts.zip
2024-12-18T00:11:09.4407690Z rm artifacts.zip
2024-12-18T00:11:09.4415073Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:11:09.4415588Z env:
2024-12-18T00:11:09.4415898Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:11:09.4416384Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:11:09.4416890Z ##[endgroup]
2024-12-18T00:11:09.5279343Z ##[group]Run df -H
2024-12-18T00:11:09.5279723Z df -H
2024-12-18T00:11:09.5286782Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:11:09.5287285Z env:
2024-12-18T00:11:09.5287590Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:11:09.5288266Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:11:09.5288766Z ##[endgroup]
2024-12-18T00:11:09.5338032Z Filesystem      Size  Used Avail Use% Mounted on
2024-12-18T00:11:09.5338672Z devtmpfs        4.2M     0  4.2M   0% /dev
2024-12-18T00:11:09.5339142Z tmpfs            65G     0   65G   0% /dev/shm
2024-12-18T00:11:09.5339588Z tmpfs            26G  562k   26G   1% /run
2024-12-18T00:11:09.5340013Z /dev/xvda1      161G   53G  109G  33% /
2024-12-18T00:11:09.5340416Z tmpfs            65G   29k   65G   1% /tmp
2024-12-18T00:11:09.5341167Z /dev/xvda128     11M  1.4M  9.2M  13% /boot/efi
2024-12-18T00:11:09.5341641Z tmpfs            13G     0   13G   0% /run/user/0
2024-12-18T00:11:09.5383641Z Prepare all required actions
2024-12-18T00:11:09.5384212Z Getting action download info
2024-12-18T00:11:09.6808081Z ##[group]Run ./.github/actions/download-td-artifacts
2024-12-18T00:11:09.6808572Z with:
2024-12-18T00:11:09.6808932Z env:
2024-12-18T00:11:09.6809239Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:11:09.6809673Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:11:09.6810162Z ##[endgroup]
2024-12-18T00:11:09.6853253Z ##[group]Run seemethere/download-artifact-s3@v4
2024-12-18T00:11:09.6853715Z with:
2024-12-18T00:11:09.6854044Z   name: td_results
2024-12-18T00:11:09.6854386Z   s3-bucket: gha-artifacts
2024-12-18T00:11:09.6854738Z   region: us-east-1
2024-12-18T00:11:09.6855065Z env:
2024-12-18T00:11:09.6855361Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:11:09.6855811Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:11:09.6856598Z ##[endgroup]
2024-12-18T00:11:10.2857986Z (node:123583) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023.
2024-12-18T00:11:10.2858616Z 
2024-12-18T00:11:10.2858891Z Please migrate your code to use AWS SDK for JavaScript (v3).
2024-12-18T00:11:10.2859565Z For more information, check the migration guide at https://a.co/7PzMCcy
2024-12-18T00:11:10.2860271Z (Use `node --trace-warnings ...` to show where the warning was created)
2024-12-18T00:11:10.4536901Z Found 1 objects with prefix pytorch/pytorch/12383255654/td_results/
2024-12-18T00:11:10.4537714Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/td_results.json
2024-12-18T00:11:10.5228772Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/td_results.json
2024-12-18T00:11:10.5237460Z Artifact download has finished successfully
2024-12-18T00:11:10.5473533Z ##[group]Run mkdir -p .additional_ci_files
2024-12-18T00:11:10.5474071Z mkdir -p .additional_ci_files
2024-12-18T00:11:10.5474718Z mv td_results.json .additional_ci_files/td_results.json || true
2024-12-18T00:11:10.5482082Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:11:10.5482604Z env:
2024-12-18T00:11:10.5482915Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:11:10.5483370Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:11:10.5483854Z ##[endgroup]
2024-12-18T00:11:10.5587711Z ##[group]Run .github/scripts/parse_ref.py
2024-12-18T00:11:10.5588270Z .github/scripts/parse_ref.py
2024-12-18T00:11:10.5595058Z shell: /usr/bin/bash -e {0}
2024-12-18T00:11:10.5595440Z env:
2024-12-18T00:11:10.5595768Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:11:10.5596222Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:11:10.5596677Z ##[endgroup]
2024-12-18T00:11:10.5960439Z Prepare all required actions
2024-12-18T00:11:10.6008102Z ##[group]Run ./.github/actions/get-workflow-job-id
2024-12-18T00:11:10.6008603Z with:
2024-12-18T00:11:10.6009149Z   github-token: ***
2024-12-18T00:11:10.6009501Z env:
2024-12-18T00:11:10.6009805Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:11:10.6010290Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:11:10.6010797Z ##[endgroup]
2024-12-18T00:11:10.6038813Z ##[group]Run set -eux
2024-12-18T00:11:10.6039217Z set -eux
2024-12-18T00:11:10.6039822Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}"
2024-12-18T00:11:10.6047577Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:11:10.6048130Z env:
2024-12-18T00:11:10.6048450Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:11:10.6048968Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:11:10.6049713Z   GITHUB_TOKEN: ***
2024-12-18T00:11:10.6050080Z ##[endgroup]
2024-12-18T00:11:10.6081680Z + python3 .github/scripts/get_workflow_job_id.py 12383255654 i-0988c0a7c81d79530
2024-12-18T00:11:11.3927613Z setting job-id=34566510375
2024-12-18T00:11:11.3928462Z setting job-name=linux-focal-cuda11.8-py3.10-gcc9-debug / test (default, 4, 5, lf.linux.4xlarge.nvidia.gpu, oncall:debug-build)
2024-12-18T00:11:11.4154104Z Prepare all required actions
2024-12-18T00:11:11.4154674Z Getting action download info
2024-12-18T00:11:11.5504760Z ##[group]Run ./.github/actions/filter-test-configs
2024-12-18T00:11:11.5505262Z with:
2024-12-18T00:11:11.5505818Z   github-token: ***
2024-12-18T00:11:11.5508668Z   test-matrix: {"include": [{"config": "default", "shard": 1, "num_shards": 5, "runner": "lf.linux.4xlarge.nvidia.gpu", "owners": ["oncall:debug-build"]}, {"config": "default", "shard": 2, "num_shards": 5, "runner": "lf.linux.4xlarge.nvidia.gpu", "owners": ["oncall:debug-build"]}, {"config": "default", "shard": 3, "num_shards": 5, "runner": "lf.linux.4xlarge.nvidia.gpu", "owners": ["oncall:debug-build"]}, {"config": "default", "shard": 4, "num_shards": 5, "runner": "lf.linux.4xlarge.nvidia.gpu", "owners": ["oncall:debug-build"]}, {"config": "default", "shard": 5, "num_shards": 5, "runner": "lf.linux.4xlarge.nvidia.gpu", "owners": ["oncall:debug-build"]}]}
2024-12-18T00:11:11.5512287Z   job-name: linux-focal-cuda11.8-py3.10-gcc9-debug / test (default, 4, 5, lf.linux.4xlarge.nvidia.gpu, oncall:debug-build)
2024-12-18T00:11:11.5513107Z env:
2024-12-18T00:11:11.5513396Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:11:11.5513854Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:11:11.5514327Z ##[endgroup]
2024-12-18T00:11:11.5597346Z ##[group]Run nick-fields/retry@v3.0.0
2024-12-18T00:11:11.5597787Z with:
2024-12-18T00:11:11.5598096Z   shell: bash
2024-12-18T00:11:11.5598408Z   timeout_minutes: 10
2024-12-18T00:11:11.5599003Z   max_attempts: 5
2024-12-18T00:11:11.5599355Z   retry_wait_seconds: 30
2024-12-18T00:11:11.5600437Z   command: set -eux
# PyYAML 6.0 doesn't work with MacOS x86 anymore
# This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2
python3 -m pip install requests==2.27.1 pyyaml==6.0.1

2024-12-18T00:11:11.5601574Z   polling_interval_seconds: 1
2024-12-18T00:11:11.5601985Z   warning_on_retry: true
2024-12-18T00:11:11.5602457Z   continue_on_error: false
2024-12-18T00:11:11.5602832Z env:
2024-12-18T00:11:11.5603138Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:11:11.5603584Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:11:11.5604297Z   GITHUB_TOKEN: ***
2024-12-18T00:11:11.5604637Z ##[endgroup]
2024-12-18T00:11:11.6891677Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1
2024-12-18T00:11:12.0219393Z Defaulting to user installation because normal site-packages is not writeable
2024-12-18T00:11:12.0431018Z Requirement already satisfied: requests==2.27.1 in /home/ec2-user/.local/lib/python3.9/site-packages (2.27.1)
2024-12-18T00:11:12.0436712Z Requirement already satisfied: pyyaml==6.0.1 in /home/ec2-user/.local/lib/python3.9/site-packages (6.0.1)
2024-12-18T00:11:12.0594713Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (1.25.10)
2024-12-18T00:11:12.0609630Z Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (2.10)
2024-12-18T00:11:12.0622454Z Requirement already satisfied: charset-normalizer~=2.0.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2.0.12)
2024-12-18T00:11:12.0630713Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2024.12.14)
2024-12-18T00:11:12.6680401Z Command completed after 1 attempt(s).
2024-12-18T00:11:12.6744902Z ##[group]Run set -x
2024-12-18T00:11:12.6745354Z set -x
2024-12-18T00:11:12.6745689Z 
2024-12-18T00:11:12.6746221Z # Use relative path here as this could be checked out anywhere, not necessarily
2024-12-18T00:11:12.6746846Z # in runner workspace
2024-12-18T00:11:12.6747364Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py"
2024-12-18T00:11:12.6754579Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:11:12.6755089Z env:
2024-12-18T00:11:12.6755399Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:11:12.6756554Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:11:12.6757125Z ##[endgroup]
2024-12-18T00:11:12.6787608Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py
2024-12-18T00:11:12.7118196Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}"
2024-12-18T00:11:12.7118786Z echo "Workflow: ${GITHUB_WORKFLOW}"
2024-12-18T00:11:12.7119272Z echo "Job name: ${JOB_NAME}"
2024-12-18T00:11:12.7119676Z 
2024-12-18T00:11:12.7120232Z # Use relative path here as this could be checked out anywhere, not necessarily
2024-12-18T00:11:12.7120896Z # in runner workspace
2024-12-18T00:11:12.7121498Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \
2024-12-18T00:11:12.7122160Z   --workflow "${GITHUB_WORKFLOW}" \
2024-12-18T00:11:12.7122644Z   --job-name "${JOB_NAME}" \
2024-12-18T00:11:12.7125632Z   --test-matrix "{"include": [{"config": "default", "shard": 1, "num_shards": 5, "runner": "lf.linux.4xlarge.nvidia.gpu", "owners": ["oncall:debug-build"]}, {"config": "default", "shard": 2, "num_shards": 5, "runner": "lf.linux.4xlarge.nvidia.gpu", "owners": ["oncall:debug-build"]}, {"config": "default", "shard": 3, "num_shards": 5, "runner": "lf.linux.4xlarge.nvidia.gpu", "owners": ["oncall:debug-build"]}, {"config": "default", "shard": 4, "num_shards": 5, "runner": "lf.linux.4xlarge.nvidia.gpu", "owners": ["oncall:debug-build"]}, {"config": "default", "shard": 5, "num_shards": 5, "runner": "lf.linux.4xlarge.nvidia.gpu", "owners": ["oncall:debug-build"]}]}" \
2024-12-18T00:11:12.7128818Z   --selected-test-configs "" \
2024-12-18T00:11:12.7129562Z   --pr-number "${PR_NUMBER}" \
2024-12-18T00:11:12.7130077Z   --tag "${TAG}" \
2024-12-18T00:11:12.7130482Z   --event-name "${EVENT_NAME}" \
2024-12-18T00:11:12.7130922Z   --schedule "${SCHEDULE}" \
2024-12-18T00:11:12.7131352Z   --branch "${HEAD_BRANCH}"
2024-12-18T00:11:12.7137833Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:11:12.7138337Z env:
2024-12-18T00:11:12.7138627Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:11:12.7139080Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:11:12.7139804Z   GITHUB_TOKEN: ***
2024-12-18T00:11:12.7140983Z   JOB_NAME: linux-focal-cuda11.8-py3.10-gcc9-debug / test (default, 4, 5, lf.linux.4xlarge.nvidia.gpu, oncall:debug-build)
2024-12-18T00:11:12.7141860Z   PR_NUMBER: 
2024-12-18T00:11:12.7142188Z   TAG: 
2024-12-18T00:11:12.7142463Z   EVENT_NAME: push
2024-12-18T00:11:12.7142790Z   SCHEDULE: 
2024-12-18T00:11:12.7143093Z   HEAD_BRANCH: 
2024-12-18T00:11:12.7143405Z ##[endgroup]
2024-12-18T00:11:12.7171043Z Workflow: periodic
2024-12-18T00:11:12.7171786Z Job name: linux-focal-cuda11.8-py3.10-gcc9-debug / test (default, 4, 5, lf.linux.4xlarge.nvidia.gpu, oncall:debug-build)
2024-12-18T00:11:13.0369803Z ##[group]Run echo "Filtered matrix:"
2024-12-18T00:11:13.0370331Z echo "Filtered matrix:"
2024-12-18T00:11:13.0373191Z echo "{"include": [{"config": "default", "shard": 1, "num_shards": 5, "runner": "lf.linux.4xlarge.nvidia.gpu", "owners": ["oncall:debug-build"]}, {"config": "default", "shard": 2, "num_shards": 5, "runner": "lf.linux.4xlarge.nvidia.gpu", "owners": ["oncall:debug-build"]}, {"config": "default", "shard": 3, "num_shards": 5, "runner": "lf.linux.4xlarge.nvidia.gpu", "owners": ["oncall:debug-build"]}, {"config": "default", "shard": 4, "num_shards": 5, "runner": "lf.linux.4xlarge.nvidia.gpu", "owners": ["oncall:debug-build"]}, {"config": "default", "shard": 5, "num_shards": 5, "runner": "lf.linux.4xlarge.nvidia.gpu", "owners": ["oncall:debug-build"]}]}"
2024-12-18T00:11:13.0376093Z 
2024-12-18T00:11:13.0376404Z echo
2024-12-18T00:11:13.0376786Z echo "Is the current job unstable? False"
2024-12-18T00:11:13.0377274Z 
2024-12-18T00:11:13.0377584Z echo
2024-12-18T00:11:13.0378194Z echo "Is keep-going label set? False"
2024-12-18T00:11:13.0378695Z 
2024-12-18T00:11:13.0378980Z echo
2024-12-18T00:11:13.0379334Z echo "Renabled issues? "
2024-12-18T00:11:13.0386793Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:11:13.0387328Z env:
2024-12-18T00:11:13.0387651Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:11:13.0388142Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:11:13.0388642Z ##[endgroup]
2024-12-18T00:11:13.0418034Z Filtered matrix:
2024-12-18T00:11:13.0422823Z {include: [{config: default, shard: 1, num_shards: 5, runner: lf.linux.4xlarge.nvidia.gpu, owners: [oncall:debug-build]}, {config: default, shard: 2, num_shards: 5, runner: lf.linux.4xlarge.nvidia.gpu, owners: [oncall:debug-build]}, {config: default, shard: 3, num_shards: 5, runner: lf.linux.4xlarge.nvidia.gpu, owners: [oncall:debug-build]}, {config: default, shard: 4, num_shards: 5, runner: lf.linux.4xlarge.nvidia.gpu, owners: [oncall:debug-build]}, {config: default, shard: 5, num_shards: 5, runner: lf.linux.4xlarge.nvidia.gpu, owners: [oncall:debug-build]}]}
2024-12-18T00:11:13.0425302Z 
2024-12-18T00:11:13.0425491Z Is the current job unstable? False
2024-12-18T00:11:13.0425788Z 
2024-12-18T00:11:13.0425944Z Is keep-going label set? False
2024-12-18T00:11:13.0426216Z 
2024-12-18T00:11:13.0426358Z Renabled issues? 
2024-12-18T00:11:13.0480446Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}"
2024-12-18T00:11:13.0481183Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}"
2024-12-18T00:11:13.0488349Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:11:13.0488859Z env:
2024-12-18T00:11:13.0489167Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:11:13.0489697Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:11:13.0490179Z   JOB_TIMEOUT: 240
2024-12-18T00:11:13.0490492Z ##[endgroup]
2024-12-18T00:11:13.0577266Z ##[group]Run set -x
2024-12-18T00:11:13.0577755Z set -x
2024-12-18T00:11:13.0578095Z 
2024-12-18T00:11:13.0578474Z if [[ $TEST_CONFIG == 'multigpu' ]]; then
2024-12-18T00:11:13.0579043Z   TEST_COMMAND=.ci/pytorch/multigpu-test.sh
2024-12-18T00:11:13.0579597Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then
2024-12-18T00:11:13.0580117Z   TEST_COMMAND=.ci/onnx/test.sh
2024-12-18T00:11:13.0580560Z else
2024-12-18T00:11:13.0580939Z   TEST_COMMAND=.ci/pytorch/test.sh
2024-12-18T00:11:13.0581393Z fi
2024-12-18T00:11:13.0581703Z 
2024-12-18T00:11:13.0582189Z # detached container should get cleaned up by teardown_ec2_linux
2024-12-18T00:11:13.0582944Z # TODO: Stop building test binaries as part of the build phase
2024-12-18T00:11:13.0583606Z # Used for GPU_FLAG since that doesn't play nice
2024-12-18T00:11:13.0584189Z # shellcheck disable=SC2086,SC2090
2024-12-18T00:11:13.0584681Z container_name=$(docker run \
2024-12-18T00:11:13.0585129Z   ${GPU_FLAG:-} \
2024-12-18T00:11:13.0585569Z   ${SCCACHE_SERVER_PORT_DOCKER_FLAG:-} \
2024-12-18T00:11:13.0586060Z   -e BUILD_ENVIRONMENT \
2024-12-18T00:11:13.0586480Z   -e PR_NUMBER \
2024-12-18T00:11:13.0586879Z   -e GITHUB_ACTIONS \
2024-12-18T00:11:13.0587305Z   -e GITHUB_REPOSITORY \
2024-12-18T00:11:13.0587745Z   -e GITHUB_WORKFLOW \
2024-12-18T00:11:13.0588165Z   -e GITHUB_JOB \
2024-12-18T00:11:13.0588546Z   -e GITHUB_RUN_ID \
2024-12-18T00:11:13.0588965Z   -e GITHUB_RUN_NUMBER \
2024-12-18T00:11:13.0589403Z   -e GITHUB_RUN_ATTEMPT \
2024-12-18T00:11:13.0589905Z   -e JOB_ID \
2024-12-18T00:11:13.0590267Z   -e JOB_NAME \
2024-12-18T00:11:13.0590613Z   -e BASE_SHA \
2024-12-18T00:11:13.0590973Z   -e BRANCH \
2024-12-18T00:11:13.0591327Z   -e SHA1 \
2024-12-18T00:11:13.0591679Z   -e AWS_DEFAULT_REGION \
2024-12-18T00:11:13.0592087Z   -e IN_WHEEL_TEST \
2024-12-18T00:11:13.0592454Z   -e SHARD_NUMBER \
2024-12-18T00:11:13.0592837Z   -e TEST_CONFIG \
2024-12-18T00:11:13.0593220Z   -e NUM_TEST_SHARDS \
2024-12-18T00:11:13.0593620Z   -e REENABLED_ISSUES \
2024-12-18T00:11:13.0594043Z   -e CONTINUE_THROUGH_ERROR \
2024-12-18T00:11:13.0594468Z   -e VERBOSE_TEST_LOGS \
2024-12-18T00:11:13.0594856Z   -e TEST_SHOWLOCALS \
2024-12-18T00:11:13.0595266Z   -e NO_TEST_TIMEOUT \
2024-12-18T00:11:13.0595650Z   -e NO_TD \
2024-12-18T00:11:13.0596009Z   -e TD_DISTRIBUTED \
2024-12-18T00:11:13.0596401Z   -e PR_LABELS \
2024-12-18T00:11:13.0596794Z   -e MAX_JOBS="$(nproc --ignore=2)" \
2024-12-18T00:11:13.0597244Z   -e SCCACHE_BUCKET \
2024-12-18T00:11:13.0597649Z   -e SCCACHE_REGION \
2024-12-18T00:11:13.0598049Z   -e SCCACHE_S3_KEY_PREFIX \
2024-12-18T00:11:13.0598460Z   -e XLA_CUDA \
2024-12-18T00:11:13.0598858Z   -e XLA_CLANG_CACHE_S3_BUCKET_NAME \
2024-12-18T00:11:13.0599318Z   -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \
2024-12-18T00:11:13.0599810Z   -e PYTORCH_TEST_RERUN_DISABLED_TESTS \
2024-12-18T00:11:13.0600297Z   -e SKIP_SCCACHE_INITIALIZATION=1 \
2024-12-18T00:11:13.0600753Z   -e HUGGING_FACE_HUB_TOKEN \
2024-12-18T00:11:13.0601197Z   -e SCRIBE_GRAPHQL_ACCESS_TOKEN \
2024-12-18T00:11:13.0601811Z   -e DASHBOARD_TAG \
2024-12-18T00:11:13.0602199Z   -e IS_A100_RUNNER \
2024-12-18T00:11:13.0602597Z   -e ARTIFACTS_FILE_SUFFIX \
2024-12-18T00:11:13.0603087Z   --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \
2024-12-18T00:11:13.0603614Z   --security-opt seccomp=unconfined \
2024-12-18T00:11:13.0604195Z   --cap-add=SYS_PTRACE \
2024-12-18T00:11:13.0604601Z   --ipc=host \
2024-12-18T00:11:13.0604973Z   --shm-size="${SHM_SIZE}" \
2024-12-18T00:11:13.0605370Z   --tty \
2024-12-18T00:11:13.0605704Z   --detach \
2024-12-18T00:11:13.0606071Z   --name="${container_name}" \
2024-12-18T00:11:13.0606476Z   --user jenkins \
2024-12-18T00:11:13.0606948Z   -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \
2024-12-18T00:11:13.0607475Z   -w /var/lib/jenkins/workspace \
2024-12-18T00:11:13.0607903Z   "${DOCKER_IMAGE}"
2024-12-18T00:11:13.0608260Z )
2024-12-18T00:11:13.0608651Z # Propagate download.pytorch.org IP to container
2024-12-18T00:11:13.0609490Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts"
2024-12-18T00:11:13.0610378Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}"
2024-12-18T00:11:13.0611261Z docker exec -t "${container_name}" sh -c "python3 -m pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}"
2024-12-18T00:11:13.0617650Z shell: /usr/bin/bash -e {0}
2024-12-18T00:11:13.0618028Z env:
2024-12-18T00:11:13.0618313Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:11:13.0618764Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:11:13.0619358Z   BUILD_ENVIRONMENT: linux-focal-cuda11.8-py3.10-gcc9-debug
2024-12-18T00:11:13.0619861Z   PR_NUMBER: 
2024-12-18T00:11:13.0620203Z   GITHUB_REPOSITORY: pytorch/pytorch
2024-12-18T00:11:13.0620621Z   GITHUB_WORKFLOW: periodic
2024-12-18T00:11:13.0620989Z   GITHUB_JOB: test
2024-12-18T00:11:13.0621321Z   GITHUB_RUN_ID: 12383255654
2024-12-18T00:11:13.0621692Z   GITHUB_RUN_NUMBER: 15427
2024-12-18T00:11:13.0622052Z   GITHUB_RUN_ATTEMPT: 1
2024-12-18T00:11:13.0622392Z   JOB_ID: 34566510375
2024-12-18T00:11:13.0623086Z   JOB_NAME: linux-focal-cuda11.8-py3.10-gcc9-debug / test (default, 4, 5, lf.linux.4xlarge.nvidia.gpu, oncall:debug-build)
2024-12-18T00:11:13.0623866Z   BRANCH: release/2.6
2024-12-18T00:11:13.0624262Z   SHA1: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:11:13.0624770Z   BASE_SHA: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:11:13.0625227Z   TEST_CONFIG: default
2024-12-18T00:11:13.0625550Z   SHARD_NUMBER: 4
2024-12-18T00:11:13.0625877Z   NUM_TEST_SHARDS: 5
2024-12-18T00:11:13.0626216Z   REENABLED_ISSUES: 
2024-12-18T00:11:13.0626566Z   CONTINUE_THROUGH_ERROR: False
2024-12-18T00:11:13.0626962Z   VERBOSE_TEST_LOGS: False
2024-12-18T00:11:13.0627316Z   TEST_SHOWLOCALS: False
2024-12-18T00:11:13.0627675Z   NO_TEST_TIMEOUT: False
2024-12-18T00:11:13.0628035Z   NO_TD: False
2024-12-18T00:11:13.0628356Z   TD_DISTRIBUTED: False
2024-12-18T00:11:13.0628782Z   SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2
2024-12-18T00:11:13.0629253Z   SCCACHE_REGION: us-east-1
2024-12-18T00:11:13.0629640Z   SCCACHE_S3_KEY_PREFIX: periodic
2024-12-18T00:11:13.0630026Z   SHM_SIZE: 2g
2024-12-18T00:11:13.0630906Z   DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda11.8-cudnn9-py3-gcc9:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:11:13.0631862Z   XLA_CUDA: 
2024-12-18T00:11:13.0632342Z   XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla
2024-12-18T00:11:13.0632917Z   PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0
2024-12-18T00:11:13.0633353Z   PYTORCH_TEST_RERUN_DISABLED_TESTS: 0
2024-12-18T00:11:13.0633768Z   DASHBOARD_TAG: 
2024-12-18T00:11:13.0634309Z   HUGGING_FACE_HUB_TOKEN: ***
2024-12-18T00:11:13.0634874Z   SCRIBE_GRAPHQL_ACCESS_TOKEN: ***
2024-12-18T00:11:13.0635269Z   IS_A100_RUNNER: 0
2024-12-18T00:11:13.0635902Z   ARTIFACTS_FILE_SUFFIX: test-default-4-5-lf.linux.4xlarge.nvidia.gpu_34566510375
2024-12-18T00:11:13.0636509Z ##[endgroup]
2024-12-18T00:11:13.0665394Z + [[ default == \m\u\l\t\i\g\p\u ]]
2024-12-18T00:11:13.0665949Z + [[ linux-focal-cuda11.8-py3.10-gcc9-debug == *onnx* ]]
2024-12-18T00:11:13.0666464Z + TEST_COMMAND=.ci/pytorch/test.sh
2024-12-18T00:11:13.0675729Z +++ nproc --ignore=2
2024-12-18T00:11:13.0692800Z ++ docker run --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e TEST_SHOWLOCALS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=14 -e SCCACHE_BUCKET -e SCCACHE_REGION -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e SCRIBE_GRAPHQL_ACCESS_TOKEN -e DASHBOARD_TAG -e IS_A100_RUNNER -e ARTIFACTS_FILE_SUFFIX --env-file=/tmp/github_env_12383255654 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=2g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda11.8-cudnn9-py3-gcc9:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:11:25.7739606Z + container_name=bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:11:25.7742744Z + grep download.pytorch.org /etc/hosts
2024-12-18T00:11:25.7744408Z + docker exec -i bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168 sudo bash -c '/bin/cat >> /etc/hosts'
2024-12-18T00:11:25.9522895Z + echo DOCKER_CONTAINER_ID=bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:11:25.9527210Z ++ echo dist/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl
2024-12-18T00:11:25.9530138Z + docker exec -t bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168 sh -c 'python3 -m pip install dist/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh'
2024-12-18T00:11:26.4858650Z Processing ./dist/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl (from torch==2.6.0a0+git0cdf8b1)
2024-12-18T00:11:27.7308841Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (3.16.1)
2024-12-18T00:11:27.7313644Z Requirement already satisfied: typing-extensions>=4.10.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (4.12.2)
2024-12-18T00:11:27.7318547Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (2.8.8)
2024-12-18T00:11:27.7323799Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (3.1.4)
2024-12-18T00:11:27.7329030Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (2024.10.0)
2024-12-18T00:11:27.7337326Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (1.13.1)
2024-12-18T00:11:27.7362552Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (1.3.0)
2024-12-18T00:11:27.7383390Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (3.3.0)
2024-12-18T00:11:27.7410244Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from opt-einsum>=3.3->torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (1.22.4)
2024-12-18T00:11:27.7944566Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (3.0.2)
2024-12-18T00:11:28.2924941Z Installing collected packages: torch
2024-12-18T00:11:42.5113440Z Successfully installed torch-2.6.0a0+git0cdf8b1
2024-12-18T00:11:42.5943831Z + export TERM=vt100
2024-12-18T00:11:42.5944217Z + TERM=vt100
2024-12-18T00:11:42.5946772Z ++ dirname .ci/pytorch/test.sh
2024-12-18T00:11:42.5955996Z + source .ci/pytorch/common.sh
2024-12-18T00:11:42.5960737Z +++ dirname .ci/pytorch/common.sh
2024-12-18T00:11:42.5969654Z ++ source .ci/pytorch/common_utils.sh
2024-12-18T00:11:42.5972137Z +++ declare -f -t trap_add
2024-12-18T00:11:42.5981101Z ++ set -ex
2024-12-18T00:11:42.5981540Z ++ [[ linux-focal-cuda11.8-py3.10-gcc9-debug == *rocm* ]]
2024-12-18T00:11:42.5982324Z ++ BUILD_TEST_LIBTORCH=0
2024-12-18T00:11:42.5983247Z + [[ linux-focal-cuda11.8-py3.10-gcc9-debug != *rocm* ]]
2024-12-18T00:11:42.5983792Z + [[ -d /var/lib/jenkins/workspace ]]
2024-12-18T00:11:42.5986923Z ++ stat -c %u /var/lib/jenkins/workspace
2024-12-18T00:11:42.6004542Z + WORKSPACE_ORIGINAL_OWNER_ID=1000
2024-12-18T00:11:42.6004987Z + trap_add cleanup_workspace EXIT
2024-12-18T00:11:42.6005394Z + trap_add_cmd=cleanup_workspace
2024-12-18T00:11:42.6005779Z + shift
2024-12-18T00:11:42.6006088Z + for trap_add_name in "$@"
2024-12-18T00:11:42.6014196Z +++ trap -p EXIT
2024-12-18T00:11:42.6017729Z ++ eval 'extract_trap_cmd '
2024-12-18T00:11:42.6018292Z +++ extract_trap_cmd
2024-12-18T00:11:42.6018622Z +++ printf '%s\n' ''
2024-12-18T00:11:42.6018987Z ++ printf '%s\n' cleanup_workspace
2024-12-18T00:11:42.6021624Z + trap -- '
2024-12-18T00:11:42.6021966Z cleanup_workspace' EXIT
2024-12-18T00:11:42.6022410Z + sudo chown -R jenkins /var/lib/jenkins/workspace
2024-12-18T00:11:43.2269732Z + git config --global --add safe.directory /var/lib/jenkins/workspace
2024-12-18T00:11:43.2292332Z + echo 'Environment variables:'
2024-12-18T00:11:43.2292842Z Environment variables:
2024-12-18T00:11:43.2293232Z + env
2024-12-18T00:11:43.2304663Z INSTALLED_DB=yes
2024-12-18T00:11:43.2305262Z NV_LIBCUBLAS_VERSION=11.11.3.6-1
2024-12-18T00:11:43.2305670Z NVIDIA_VISIBLE_DEVICES=all
2024-12-18T00:11:43.2306052Z NV_NVML_DEV_VERSION=11.8.86-1
2024-12-18T00:11:43.2306595Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch
2024-12-18T00:11:43.2307174Z CONTINUE_THROUGH_ERROR=False
2024-12-18T00:11:43.2307628Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.16.2-1+cuda11.8
2024-12-18T00:11:43.2308103Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.16.2-1
2024-12-18T00:11:43.2308621Z BUILD_ENVIRONMENT=linux-focal-cuda11.8-py3.10-gcc9-debug
2024-12-18T00:11:43.2309155Z HOSTNAME=bc82ba0d0766
2024-12-18T00:11:43.2309889Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_a9fc2107-d388-456b-9929-9646c7a2a296
2024-12-18T00:11:43.2310681Z GITHUB_ACTION=__self
2024-12-18T00:11:43.2311247Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0
2024-12-18T00:11:43.2313363Z NVIDIA_REQUIRE_CUDA=cuda>=11.8 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471
2024-12-18T00:11:43.2315457Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-11-8=11.11.3.6-1
2024-12-18T00:11:43.2315950Z NV_NVTX_VERSION=11.8.86-1
2024-12-18T00:11:43.2316316Z GITHUB_RUN_NUMBER=15427
2024-12-18T00:11:43.2316666Z TEST_CONFIG=default
2024-12-18T00:11:43.2317321Z GITHUB_REPOSITORY_OWNER_ID=21003710
2024-12-18T00:11:43.2317743Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all
2024-12-18T00:11:43.2318164Z IS_A100_RUNNER=0
2024-12-18T00:11:43.2318509Z NV_CUDA_CUDART_DEV_VERSION=11.8.89-1
2024-12-18T00:11:43.2318932Z NV_LIBCUSPARSE_VERSION=11.7.5.86-1
2024-12-18T00:11:43.2319620Z SCRIBE_GRAPHQL_ACCESS_TOKEN=***
2024-12-18T00:11:43.2320194Z NV_LIBNPP_VERSION=11.8.0.86-1
2024-12-18T00:11:43.2320600Z GITHUB_TRIGGERING_ACTOR=malfet
2024-12-18T00:11:43.2321048Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache
2024-12-18T00:11:43.2321517Z GITHUB_REF_TYPE=branch
2024-12-18T00:11:43.2321875Z TORCH_CUDA_ARCH_LIST=Maxwell
2024-12-18T00:11:43.2322251Z NCCL_VERSION=2.16.2-1
2024-12-18T00:11:43.2322632Z BASE_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:11:43.2323080Z XLA_CUDA=
2024-12-18T00:11:43.2323532Z HUGGING_FACE_HUB_TOKEN=***
2024-12-18T00:11:43.2326649Z ***
2024-12-18T00:11:43.2326984Z CARGO_NET_GIT_FETCH_WITH_CLI=true
2024-12-18T00:11:43.2327380Z GITHUB_REPOSITORY_ID=65600975
2024-12-18T00:11:43.2327775Z GITHUB_ACTIONS=true
2024-12-18T00:11:43.2328124Z NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:11:43.2328563Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-11-8=11.8.87-1
2024-12-18T00:11:43.2329052Z NV_LIBNPP_PACKAGE=libnpp-11-8=11.8.0.86-1
2024-12-18T00:11:43.2329505Z SHA1=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:11:43.2329988Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev
2024-12-18T00:11:43.2330474Z GITHUB_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:11:43.2331183Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/periodic.yml@refs/heads/release/2.6
2024-12-18T00:11:43.2331830Z UCC_HOME=/usr
2024-12-18T00:11:43.2332143Z NV_LIBCUBLAS_DEV_VERSION=11.11.3.6-1
2024-12-18T00:11:43.2332554Z VERBOSE_TEST_LOGS=False
2024-12-18T00:11:43.2332913Z NVIDIA_PRODUCT_NAME=CUDA
2024-12-18T00:11:43.2333331Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-11-8
2024-12-18T00:11:43.2333804Z GITHUB_REF=refs/heads/release/2.6
2024-12-18T00:11:43.2334196Z NV_CUDA_CUDART_VERSION=11.8.89-1
2024-12-18T00:11:43.2334599Z SHARD_NUMBER=4
2024-12-18T00:11:43.2334928Z GITHUB_REF_PROTECTED=true
2024-12-18T00:11:43.2335291Z HOME=/var/lib/jenkins
2024-12-18T00:11:43.2335677Z GITHUB_API_URL=https://api.github.com
2024-12-18T00:11:43.2336103Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0
2024-12-18T00:11:43.2336568Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb
2024-12-18T00:11:43.2337051Z SCCACHE_S3_KEY_PREFIX=periodic
2024-12-18T00:11:43.2337434Z CUDA_VERSION=11.8.0
2024-12-18T00:11:43.2337819Z NV_LIBCUBLAS_PACKAGE=libcublas-11-8=11.11.3.6-1
2024-12-18T00:11:43.2338246Z NUM_TEST_SHARDS=5
2024-12-18T00:11:43.2338573Z UCX_HOME=/usr
2024-12-18T00:11:43.2339032Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-11-8=11.8.0-1
2024-12-18T00:11:43.2339971Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_a9fc2107-d388-456b-9929-9646c7a2a296
2024-12-18T00:11:43.2341133Z JOB_NAME=linux-focal-cuda11.8-py3.10-gcc9-debug / test (default, 4, 5, lf.linux.4xlarge.nvidia.gpu, oncall:debug-build)
2024-12-18T00:11:43.2342308Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_a9fc2107-d388-456b-9929-9646c7a2a296
2024-12-18T00:11:43.2343384Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json
2024-12-18T00:11:43.2344083Z GITHUB_EVENT_NAME=push
2024-12-18T00:11:43.2344447Z DASHBOARD_TAG=
2024-12-18T00:11:43.2344792Z GITHUB_RUN_ID=12383255654
2024-12-18T00:11:43.2345242Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-11-8=11.8.0.86-1
2024-12-18T00:11:43.2345753Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-11-8
2024-12-18T00:11:43.2346700Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_a9fc2107-d388-456b-9929-9646c7a2a296
2024-12-18T00:11:43.2347611Z GITHUB_ACTOR=malfet
2024-12-18T00:11:43.2347979Z NV_LIBNPP_DEV_VERSION=11.8.0.86-1
2024-12-18T00:11:43.2348387Z PR_NUMBER=
2024-12-18T00:11:43.2348686Z GITHUB_RUN_ATTEMPT=1
2024-12-18T00:11:43.2349058Z ANACONDA_PYTHON_VERSION=3.10
2024-12-18T00:11:43.2349713Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql
2024-12-18T00:11:43.2350235Z TERM=vt100
2024-12-18T00:11:43.2350577Z NV_LIBCUSPARSE_DEV_VERSION=11.7.5.86-1
2024-12-18T00:11:43.2351022Z INSTALLED_VISION=yes
2024-12-18T00:11:43.2351365Z BRANCH=release/2.6
2024-12-18T00:11:43.2351719Z SCCACHE_REGION=us-east-1
2024-12-18T00:11:43.2352117Z OPENSSL_ROOT_DIR=/opt/openssl
2024-12-18T00:11:43.2352660Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs
2024-12-18T00:11:43.2353142Z CUDA_PATH=/usr/local/cuda
2024-12-18T00:11:43.2353839Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux
2024-12-18T00:11:43.2354631Z GITHUB_SERVER_URL=https://github.com
2024-12-18T00:11:43.2355149Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b
2024-12-18T00:11:43.2355647Z REENABLED_ISSUES=
2024-12-18T00:11:43.2356438Z SHLVL=1
2024-12-18T00:11:43.2356911Z MAX_JOBS=14
2024-12-18T00:11:43.2357437Z NV_CUDA_LIB_VERSION=11.8.0-1
2024-12-18T00:11:43.2357821Z NVARCH=x86_64
2024-12-18T00:11:43.2358153Z GITHUB_ACTOR_ID=2453524
2024-12-18T00:11:43.2358589Z GITHUB_WORKFLOW_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:11:43.2359109Z GITHUB_REF_NAME=release/2.6
2024-12-18T00:11:43.2359511Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-11-8
2024-12-18T00:11:43.2360101Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla
2024-12-18T00:11:43.2360671Z GITHUB_JOB=test
2024-12-18T00:11:43.2361019Z NV_LIBNCCL_PACKAGE=libnccl2=2.16.2-1+cuda11.8
2024-12-18T00:11:43.2361564Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64
2024-12-18T00:11:43.2362070Z NO_TEST_TIMEOUT=False
2024-12-18T00:11:43.2362419Z TD_DISTRIBUTED=False
2024-12-18T00:11:43.2362792Z NV_CUDA_NSIGHT_COMPUTE_VERSION=11.8.0-1
2024-12-18T00:11:43.2363221Z GITHUB_REPOSITORY=pytorch/pytorch
2024-12-18T00:11:43.2363637Z NV_NVPROF_VERSION=11.8.87-1
2024-12-18T00:11:43.2364012Z GITHUB_RETENTION_DAYS=90
2024-12-18T00:11:43.2364379Z OPENSSL_DIR=/opt/openssl
2024-12-18T00:11:43.2364749Z GITHUB_ACTION_REPOSITORY=
2024-12-18T00:11:43.2365694Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2024-12-18T00:11:43.2366669Z GITHUB_BASE_REF=
2024-12-18T00:11:43.2367210Z ARTIFACTS_FILE_SUFFIX=test-default-4-5-lf.linux.4xlarge.nvidia.gpu_34566510375
2024-12-18T00:11:43.2367849Z NV_LIBNCCL_PACKAGE_NAME=libnccl2
2024-12-18T00:11:43.2368231Z CI=true
2024-12-18T00:11:43.2368552Z NV_LIBNCCL_PACKAGE_VERSION=2.16.2-1
2024-12-18T00:11:43.2368955Z GITHUB_REPOSITORY_OWNER=pytorch
2024-12-18T00:11:43.2369341Z JOB_ID=34566510375
2024-12-18T00:11:43.2369681Z INSTALLED_PROTOBUF=yes
2024-12-18T00:11:43.2370031Z GITHUB_HEAD_REF=
2024-12-18T00:11:43.2370341Z GITHUB_ACTION_REF=
2024-12-18T00:11:43.2370741Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2
2024-12-18T00:11:43.2371216Z TEST_SHOWLOCALS=False
2024-12-18T00:11:43.2371570Z GITHUB_WORKFLOW=periodic
2024-12-18T00:11:43.2371942Z DEBIAN_FRONTEND=noninteractive
2024-12-18T00:11:43.2372718Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_a9fc2107-d388-456b-9929-9646c7a2a296
2024-12-18T00:11:43.2373504Z NO_TD=False
2024-12-18T00:11:43.2373831Z SKIP_SCCACHE_INITIALIZATION=1
2024-12-18T00:11:43.2374207Z _=/usr/bin/env
2024-12-18T00:11:43.2374634Z ++ python -c 'import site; print(site.getsitepackages()[0])'
2024-12-18T00:11:43.2613665Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch
2024-12-18T00:11:43.2614790Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/bin
2024-12-18T00:11:43.2615535Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/lib
2024-12-18T00:11:43.2616297Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/test
2024-12-18T00:11:43.2617025Z + BUILD_DIR=build
2024-12-18T00:11:43.2617568Z + BUILD_RENAMED_DIR=build_renamed
2024-12-18T00:11:43.2617975Z + BUILD_BIN_DIR=build/bin
2024-12-18T00:11:43.2618349Z + SHARD_NUMBER=4
2024-12-18T00:11:43.2618959Z + NUM_TEST_SHARDS=5
2024-12-18T00:11:43.2619295Z + export VALGRIND=ON
2024-12-18T00:11:43.2619632Z + VALGRIND=ON
2024-12-18T00:11:43.2620031Z + [[ linux-focal-cuda11.8-py3.10-gcc9-debug == *clang9* ]]
2024-12-18T00:11:43.2620616Z + [[ linux-focal-cuda11.8-py3.10-gcc9-debug == *xpu* ]]
2024-12-18T00:11:43.2621095Z + [[ 0 == \1 ]]
2024-12-18T00:11:43.2621538Z + [[ False == \1 ]]
2024-12-18T00:11:43.2621981Z + [[ linux-focal-cuda11.8-py3.10-gcc9-debug != *bazel* ]]
2024-12-18T00:11:43.2623774Z ++ realpath build/custom_test_artifacts
2024-12-18T00:11:43.2634364Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts
2024-12-18T00:11:43.2635000Z + [[ -n '' ]]
2024-12-18T00:11:43.2635338Z + echo 'Environment variables'
2024-12-18T00:11:43.2635733Z Environment variables
2024-12-18T00:11:43.2636068Z + env
2024-12-18T00:11:43.2643864Z INSTALLED_DB=yes
2024-12-18T00:11:43.2644453Z NV_LIBCUBLAS_VERSION=11.11.3.6-1
2024-12-18T00:11:43.2644967Z NVIDIA_VISIBLE_DEVICES=all
2024-12-18T00:11:43.2645685Z NV_NVML_DEV_VERSION=11.8.86-1
2024-12-18T00:11:43.2646486Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch
2024-12-18T00:11:43.2647053Z CONTINUE_THROUGH_ERROR=False
2024-12-18T00:11:43.2647465Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.16.2-1+cuda11.8
2024-12-18T00:11:43.2647963Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.16.2-1
2024-12-18T00:11:43.2648496Z BUILD_ENVIRONMENT=linux-focal-cuda11.8-py3.10-gcc9-debug
2024-12-18T00:11:43.2649317Z HOSTNAME=bc82ba0d0766
2024-12-18T00:11:43.2650096Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_a9fc2107-d388-456b-9929-9646c7a2a296
2024-12-18T00:11:43.2650858Z GITHUB_ACTION=__self
2024-12-18T00:11:43.2651225Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0
2024-12-18T00:11:43.2653569Z NVIDIA_REQUIRE_CUDA=cuda>=11.8 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471
2024-12-18T00:11:43.2656881Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-11-8=11.11.3.6-1
2024-12-18T00:11:43.2657363Z NV_NVTX_VERSION=11.8.86-1
2024-12-18T00:11:43.2657734Z GITHUB_RUN_NUMBER=15427
2024-12-18T00:11:43.2658130Z TEST_CONFIG=default
2024-12-18T00:11:43.2658783Z GITHUB_REPOSITORY_OWNER_ID=21003710
2024-12-18T00:11:43.2659543Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all
2024-12-18T00:11:43.2659970Z IS_A100_RUNNER=0
2024-12-18T00:11:43.2660298Z NV_CUDA_CUDART_DEV_VERSION=11.8.89-1
2024-12-18T00:11:43.2660700Z NV_LIBCUSPARSE_VERSION=11.7.5.86-1
2024-12-18T00:11:43.2661320Z SCRIBE_GRAPHQL_ACCESS_TOKEN=***
2024-12-18T00:11:43.2661725Z NV_LIBNPP_VERSION=11.8.0.86-1
2024-12-18T00:11:43.2662123Z GITHUB_TRIGGERING_ACTOR=malfet
2024-12-18T00:11:43.2662562Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache
2024-12-18T00:11:43.2663043Z GITHUB_REF_TYPE=branch
2024-12-18T00:11:43.2663381Z TORCH_CUDA_ARCH_LIST=Maxwell
2024-12-18T00:11:43.2663749Z NCCL_VERSION=2.16.2-1
2024-12-18T00:11:43.2664150Z BASE_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:11:43.2664592Z XLA_CUDA=
2024-12-18T00:11:43.2665036Z HUGGING_FACE_HUB_TOKEN=***
2024-12-18T00:11:43.2665612Z ***
2024-12-18T00:11:43.2665930Z CARGO_NET_GIT_FETCH_WITH_CLI=true
2024-12-18T00:11:43.2666346Z GITHUB_REPOSITORY_ID=65600975
2024-12-18T00:11:43.2666725Z GITHUB_ACTIONS=true
2024-12-18T00:11:43.2667078Z NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:11:43.2667498Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-11-8=11.8.87-1
2024-12-18T00:11:43.2667985Z NV_LIBNPP_PACKAGE=libnpp-11-8=11.8.0.86-1
2024-12-18T00:11:43.2668451Z SHA1=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:11:43.2668919Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev
2024-12-18T00:11:43.2669396Z GITHUB_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:11:43.2670160Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/periodic.yml@refs/heads/release/2.6
2024-12-18T00:11:43.2671041Z UCC_HOME=/usr
2024-12-18T00:11:43.2671357Z NV_LIBCUBLAS_DEV_VERSION=11.11.3.6-1
2024-12-18T00:11:43.2671767Z VERBOSE_TEST_LOGS=False
2024-12-18T00:11:43.2672129Z NVIDIA_PRODUCT_NAME=CUDA
2024-12-18T00:11:43.2672550Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-11-8
2024-12-18T00:11:43.2673151Z GITHUB_REF=refs/heads/release/2.6
2024-12-18T00:11:43.2673562Z NV_CUDA_CUDART_VERSION=11.8.89-1
2024-12-18T00:11:43.2673946Z SHARD_NUMBER=4
2024-12-18T00:11:43.2674277Z GITHUB_REF_PROTECTED=true
2024-12-18T00:11:43.2674641Z HOME=/var/lib/jenkins
2024-12-18T00:11:43.2675023Z GITHUB_API_URL=https://api.github.com
2024-12-18T00:11:43.2675447Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0
2024-12-18T00:11:43.2675914Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb
2024-12-18T00:11:43.2676388Z SCCACHE_S3_KEY_PREFIX=periodic
2024-12-18T00:11:43.2676773Z CUDA_VERSION=11.8.0
2024-12-18T00:11:43.2677153Z NV_LIBCUBLAS_PACKAGE=libcublas-11-8=11.11.3.6-1
2024-12-18T00:11:43.2677590Z NUM_TEST_SHARDS=5
2024-12-18T00:11:43.2677912Z UCX_HOME=/usr
2024-12-18T00:11:43.2678362Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-11-8=11.8.0-1
2024-12-18T00:11:43.2679294Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_a9fc2107-d388-456b-9929-9646c7a2a296
2024-12-18T00:11:43.2680460Z JOB_NAME=linux-focal-cuda11.8-py3.10-gcc9-debug / test (default, 4, 5, lf.linux.4xlarge.nvidia.gpu, oncall:debug-build)
2024-12-18T00:11:43.2681577Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_a9fc2107-d388-456b-9929-9646c7a2a296
2024-12-18T00:11:43.2682567Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json
2024-12-18T00:11:43.2683204Z GITHUB_EVENT_NAME=push
2024-12-18T00:11:43.2683551Z DASHBOARD_TAG=
2024-12-18T00:11:43.2683877Z GITHUB_RUN_ID=12383255654
2024-12-18T00:11:43.2684278Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-11-8=11.8.0.86-1
2024-12-18T00:11:43.2684764Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-11-8
2024-12-18T00:11:43.2685634Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_a9fc2107-d388-456b-9929-9646c7a2a296
2024-12-18T00:11:43.2686462Z GITHUB_ACTOR=malfet
2024-12-18T00:11:43.2686808Z NV_LIBNPP_DEV_VERSION=11.8.0.86-1
2024-12-18T00:11:43.2687194Z PR_NUMBER=
2024-12-18T00:11:43.2687482Z GITHUB_RUN_ATTEMPT=1
2024-12-18T00:11:43.2687830Z VALGRIND=ON
2024-12-18T00:11:43.2688154Z ANACONDA_PYTHON_VERSION=3.10
2024-12-18T00:11:43.2688606Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql
2024-12-18T00:11:43.2689067Z TERM=vt100
2024-12-18T00:11:43.2689376Z NV_LIBCUSPARSE_DEV_VERSION=11.7.5.86-1
2024-12-18T00:11:43.2689788Z INSTALLED_VISION=yes
2024-12-18T00:11:43.2690131Z BRANCH=release/2.6
2024-12-18T00:11:43.2690469Z SCCACHE_REGION=us-east-1
2024-12-18T00:11:43.2690825Z OPENSSL_ROOT_DIR=/opt/openssl
2024-12-18T00:11:43.2691233Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs
2024-12-18T00:11:43.2691657Z CUDA_PATH=/usr/local/cuda
2024-12-18T00:11:43.2692324Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux
2024-12-18T00:11:43.2693130Z GITHUB_SERVER_URL=https://github.com
2024-12-18T00:11:43.2693596Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b
2024-12-18T00:11:43.2694058Z REENABLED_ISSUES=
2024-12-18T00:11:43.2694378Z SHLVL=1
2024-12-18T00:11:43.2694670Z MAX_JOBS=14
2024-12-18T00:11:43.2694991Z NV_CUDA_LIB_VERSION=11.8.0-1
2024-12-18T00:11:43.2695341Z NVARCH=x86_64
2024-12-18T00:11:43.2695659Z GITHUB_ACTOR_ID=2453524
2024-12-18T00:11:43.2696114Z GITHUB_WORKFLOW_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:11:43.2696631Z GITHUB_REF_NAME=release/2.6
2024-12-18T00:11:43.2697036Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-11-8
2024-12-18T00:11:43.2697601Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla
2024-12-18T00:11:43.2698163Z GITHUB_JOB=test
2024-12-18T00:11:43.2698524Z NV_LIBNCCL_PACKAGE=libnccl2=2.16.2-1+cuda11.8
2024-12-18T00:11:43.2699061Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64
2024-12-18T00:11:43.2699683Z NO_TEST_TIMEOUT=False
2024-12-18T00:11:43.2700013Z TD_DISTRIBUTED=False
2024-12-18T00:11:43.2700382Z NV_CUDA_NSIGHT_COMPUTE_VERSION=11.8.0-1
2024-12-18T00:11:43.2700820Z GITHUB_REPOSITORY=pytorch/pytorch
2024-12-18T00:11:43.2701227Z NV_NVPROF_VERSION=11.8.87-1
2024-12-18T00:11:43.2701599Z GITHUB_RETENTION_DAYS=90
2024-12-18T00:11:43.2702029Z OPENSSL_DIR=/opt/openssl
2024-12-18T00:11:43.2702413Z GITHUB_ACTION_REPOSITORY=
2024-12-18T00:11:43.2703355Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2024-12-18T00:11:43.2704321Z GITHUB_BASE_REF=
2024-12-18T00:11:43.2704858Z ARTIFACTS_FILE_SUFFIX=test-default-4-5-lf.linux.4xlarge.nvidia.gpu_34566510375
2024-12-18T00:11:43.2705471Z NV_LIBNCCL_PACKAGE_NAME=libnccl2
2024-12-18T00:11:43.2705852Z CI=true
2024-12-18T00:11:43.2706167Z NV_LIBNCCL_PACKAGE_VERSION=2.16.2-1
2024-12-18T00:11:43.2706603Z GITHUB_REPOSITORY_OWNER=pytorch
2024-12-18T00:11:43.2706981Z JOB_ID=34566510375
2024-12-18T00:11:43.2707291Z INSTALLED_PROTOBUF=yes
2024-12-18T00:11:43.2724622Z GITHUB_HEAD_REF=
2024-12-18T00:11:43.2724987Z GITHUB_ACTION_REF=
2024-12-18T00:11:43.2725398Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2
2024-12-18T00:11:43.2725862Z TEST_SHOWLOCALS=False
2024-12-18T00:11:43.2726242Z GITHUB_WORKFLOW=periodic
2024-12-18T00:11:43.2726630Z DEBIAN_FRONTEND=noninteractive
2024-12-18T00:11:43.2727429Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_a9fc2107-d388-456b-9929-9646c7a2a296
2024-12-18T00:11:43.2728251Z NO_TD=False
2024-12-18T00:11:43.2728564Z SKIP_SCCACHE_INITIALIZATION=1
2024-12-18T00:11:43.2728955Z _=/usr/bin/env
2024-12-18T00:11:43.2729282Z + echo 'Testing pytorch'
2024-12-18T00:11:43.2729643Z Testing pytorch
2024-12-18T00:11:43.2729995Z + export LANG=C.UTF-8
2024-12-18T00:11:43.2730318Z + LANG=C.UTF-8
2024-12-18T00:11:43.2730633Z + PR_NUMBER=
2024-12-18T00:11:43.2730966Z + [[ default == \d\e\f\a\u\l\t ]]
2024-12-18T00:11:43.2731375Z + export CUDA_VISIBLE_DEVICES=0
2024-12-18T00:11:43.2731764Z + CUDA_VISIBLE_DEVICES=0
2024-12-18T00:11:43.2732122Z + export HIP_VISIBLE_DEVICES=0
2024-12-18T00:11:43.2732505Z + HIP_VISIBLE_DEVICES=0
2024-12-18T00:11:43.2732869Z + [[ default == \d\i\s\t\r\i\b\u\t\e\d ]]
2024-12-18T00:11:43.2733295Z + [[ default == \s\l\o\w ]]
2024-12-18T00:11:43.2733799Z + [[ linux-focal-cuda11.8-py3.10-gcc9-debug == *slow-gradcheck* ]]
2024-12-18T00:11:43.2734399Z + [[ linux-focal-cuda11.8-py3.10-gcc9-debug == *cuda* ]]
2024-12-18T00:11:43.2734923Z + export PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda
2024-12-18T00:11:43.2735386Z + PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda
2024-12-18T00:11:43.2735806Z + [[ default == *crossref* ]]
2024-12-18T00:11:43.2736258Z + [[ linux-focal-cuda11.8-py3.10-gcc9-debug == *rocm* ]]
2024-12-18T00:11:43.2736790Z + [[ linux-focal-cuda11.8-py3.10-gcc9-debug == *xpu* ]]
2024-12-18T00:11:43.2737363Z + [[ linux-focal-cuda11.8-py3.10-gcc9-debug != *-bazel-* ]]
2024-12-18T00:11:43.2737894Z + pip_install --user ninja==1.10.2
2024-12-18T00:11:43.2738404Z + pip_install_pkg='python3 -m pip install --progress-bar off'
2024-12-18T00:11:43.2739029Z + python3 -m pip install --progress-bar off --user ninja==1.10.2
2024-12-18T00:11:43.8629926Z Collecting ninja==1.10.2
2024-12-18T00:11:43.8904901Z   Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB)
2024-12-18T00:11:43.9053413Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB)
2024-12-18T00:11:44.4030119Z Installing collected packages: ninja
2024-12-18T00:11:44.4139762Z   WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH.
2024-12-18T00:11:44.4141009Z   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
2024-12-18T00:11:44.4191894Z Successfully installed ninja-1.10.2
2024-12-18T00:11:44.4984814Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2024-12-18T00:11:44.4987002Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2024-12-18T00:11:44.4988259Z + [[ linux-focal-cuda11.8-py3.10-gcc9-debug == *aarch64* ]]
2024-12-18T00:11:44.4988762Z + install_tlparse
2024-12-18T00:11:44.4989110Z + pip_install --user tlparse==0.3.25
2024-12-18T00:11:44.4989636Z + pip_install_pkg='python3 -m pip install --progress-bar off'
2024-12-18T00:11:44.4990276Z + python3 -m pip install --progress-bar off --user tlparse==0.3.25
2024-12-18T00:11:45.0102573Z Collecting tlparse==0.3.25
2024-12-18T00:11:45.0322354Z   Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.7 kB)
2024-12-18T00:11:45.0437668Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB)
2024-12-18T00:11:45.5674602Z Installing collected packages: tlparse
2024-12-18T00:11:45.6104373Z Successfully installed tlparse-0.3.25
2024-12-18T00:11:45.6864187Z ++ python -m site --user-base
2024-12-18T00:11:45.7198593Z + PATH=/var/lib/jenkins/.local/bin:/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2024-12-18T00:11:45.7200500Z + [[ linux-focal-cuda11.8-py3.10-gcc9-debug == *asan* ]]
2024-12-18T00:11:45.7201077Z + [[ linux-focal-cuda11.8-py3.10-gcc9-debug == *-debug* ]]
2024-12-18T00:11:45.7201877Z + echo 'We are in debug mode: linux-focal-cuda11.8-py3.10-gcc9-debug. Expect the python assertion to fail'
2024-12-18T00:11:45.7202835Z We are in debug mode: linux-focal-cuda11.8-py3.10-gcc9-debug. Expect the python assertion to fail
2024-12-18T00:11:45.7205390Z + cd test
2024-12-18T00:11:45.7205954Z + get_exit_code python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)'
2024-12-18T00:11:45.7206539Z + set +e
2024-12-18T00:11:45.7206990Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)'
2024-12-18T00:11:47.7950597Z Traceback (most recent call last):
2024-12-18T00:11:47.7951110Z   File "<string>", line 1, in <module>
2024-12-18T00:11:47.7952420Z RuntimeError: THPUtils_unpackInt(arg) != 424242 INTERNAL ASSERT FAILED at "/var/lib/jenkins/workspace/torch/csrc/Module.cpp":304, please report a bug to PyTorch. Expect anything but 424242 as an input for debug builds
2024-12-18T00:11:48.0792410Z + retcode=1
2024-12-18T00:11:48.0792778Z + set -e
2024-12-18T00:11:48.0793079Z + return 1
2024-12-18T00:11:48.0795386Z + [[ default == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]]
2024-12-18T00:11:48.0795882Z + [[ default == \n\o\g\p\u\_\A\V\X\5\1\2 ]]
2024-12-18T00:11:48.0803262Z + DYNAMO_BENCHMARK_FLAGS=()
2024-12-18T00:11:48.0805311Z + [[ default == *pr_time_benchmarks* ]]
2024-12-18T00:11:48.0805997Z + [[ default == *dynamo_eager* ]]
2024-12-18T00:11:48.0806426Z + [[ default == *aot_eager* ]]
2024-12-18T00:11:48.0806815Z + [[ default == *aot_inductor* ]]
2024-12-18T00:11:48.0807212Z + [[ default == *inductor* ]]
2024-12-18T00:11:48.0807580Z + [[ default == *dynamic* ]]
2024-12-18T00:11:48.0807942Z + [[ default == *cpu* ]]
2024-12-18T00:11:48.0808368Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda)
2024-12-18T00:11:48.0846493Z + [[ linux-focal-cuda11.8-py3.10-gcc9-debug == *libtorch* ]]
2024-12-18T00:11:48.0847109Z + [[ linux-focal-cuda11.8-py3.10-gcc9-debug == *-bazel-* ]]
2024-12-18T00:11:48.0850676Z + cd test
2024-12-18T00:11:48.0851101Z + python -c 'import torch; print(torch.__config__.show())'
2024-12-18T00:11:50.1434588Z PyTorch built with:
2024-12-18T00:11:50.1435011Z   - GCC 9.4
2024-12-18T00:11:50.1435338Z   - C++ Version: 201703
2024-12-18T00:11:50.1436071Z   - Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications
2024-12-18T00:11:50.1437428Z   - Intel(R) MKL-DNN v3.5.3 (Git Hash 66f0cb9eb66affd2da3bf5f8d897376f04aae6af)
2024-12-18T00:11:50.1438066Z   - OpenMP 201511 (a.k.a. OpenMP 4.5)
2024-12-18T00:11:50.1438541Z   - LAPACK is enabled (usually provided by MKL)
2024-12-18T00:11:50.1439021Z   - NNPACK is enabled
2024-12-18T00:11:50.1439406Z   - CPU capability usage: AVX2
2024-12-18T00:11:50.1440029Z   - CUDA Runtime 11.8
2024-12-18T00:11:50.1440576Z   - NVCC architecture flags: -gencode;arch=compute_52,code=sm_52
2024-12-18T00:11:50.1441106Z   - CuDNN 90.1
2024-12-18T00:11:50.1441435Z   - Magma 2.6.1
2024-12-18T00:11:50.1447988Z   - Build settings: BLAS_INFO=mkl, BUILD_TYPE=RelWithAssert, COMMIT_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7, CUDA_VERSION=11.8, CUDNN_VERSION=9.1.0, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DUSE_KINETO -DLIBKINETO_NOROCTRACER -DLIBKINETO_NOXPUPTI=ON -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Werror -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, FORCE_FALLBACK_CUDA_MPI=1, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, TORCH_VERSION=2.6.0, USE_CUDA=ON, USE_CUDNN=ON, USE_CUSPARSELT=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=ON, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, 
2024-12-18T00:11:50.1454949Z 
2024-12-18T00:11:50.4428582Z + cd test
2024-12-18T00:11:50.4429152Z + python -c 'import torch; print(torch.__config__.parallel_info())'
2024-12-18T00:11:52.4710212Z ATen/Parallel:
2024-12-18T00:11:52.4710661Z 	at::get_num_threads() : 8
2024-12-18T00:11:52.4711081Z 	at::get_num_interop_threads() : 8
2024-12-18T00:11:52.4711489Z OpenMP 201511 (a.k.a. OpenMP 4.5)
2024-12-18T00:11:52.4711898Z 	omp_get_max_threads() : 8
2024-12-18T00:11:52.4712647Z Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications
2024-12-18T00:11:52.4713402Z 	mkl_get_max_threads() : 8
2024-12-18T00:11:52.4713923Z Intel(R) MKL-DNN v3.5.3 (Git Hash 66f0cb9eb66affd2da3bf5f8d897376f04aae6af)
2024-12-18T00:11:52.4714553Z std::thread::hardware_concurrency() : 16
2024-12-18T00:11:52.4715020Z Environment variables:
2024-12-18T00:11:52.4715410Z 	OMP_NUM_THREADS : [not set]
2024-12-18T00:11:52.4715822Z 	MKL_NUM_THREADS : [not set]
2024-12-18T00:11:52.4716238Z ATen parallel backend: OpenMP
2024-12-18T00:11:52.4716512Z 
2024-12-18T00:11:52.7521935Z + [[ default == *numpy_2* ]]
2024-12-18T00:11:52.7522765Z + [[ linux-focal-cuda11.8-py3.10-gcc9-debug == *aarch64* ]]
2024-12-18T00:11:52.7523296Z + [[ default == *backward* ]]
2024-12-18T00:11:52.7523659Z + [[ default == *xla* ]]
2024-12-18T00:11:52.7524023Z + [[ default == *executorch* ]]
2024-12-18T00:11:52.7524424Z + [[ default == \j\i\t\_\l\e\g\a\c\y ]]
2024-12-18T00:11:52.7524946Z + [[ linux-focal-cuda11.8-py3.10-gcc9-debug == *libtorch* ]]
2024-12-18T00:11:52.7525458Z + [[ default == distributed ]]
2024-12-18T00:11:52.7525843Z + [[ default == *inductor_distributed* ]]
2024-12-18T00:11:52.7526282Z + [[ default == *inductor-halide* ]]
2024-12-18T00:11:52.7526714Z + [[ default == *inductor-triton-cpu* ]]
2024-12-18T00:11:52.7527180Z + [[ default == *inductor-micro-benchmark* ]]
2024-12-18T00:11:52.7527632Z + [[ default == *huggingface* ]]
2024-12-18T00:11:52.7528191Z + [[ default == *timm* ]]
2024-12-18T00:11:52.7528576Z + [[ default == *torchbench* ]]
2024-12-18T00:11:52.7528985Z + [[ default == *inductor_cpp_wrapper* ]]
2024-12-18T00:11:52.7529825Z + [[ default == *inductor* ]]
2024-12-18T00:11:52.7530216Z + [[ default == *dynamo_wrapped* ]]
2024-12-18T00:11:52.7530684Z + [[ linux-focal-cuda11.8-py3.10-gcc9-debug == *rocm* ]]
2024-12-18T00:11:52.7531157Z + [[ 4 == 1 ]]
2024-12-18T00:11:52.7531463Z + [[ 4 == 2 ]]
2024-12-18T00:11:52.7531781Z + [[ 4 -gt 2 ]]
2024-12-18T00:11:52.7532107Z + install_torchvision
2024-12-18T00:11:52.7532631Z + local orig_preload
2024-12-18T00:11:52.7533000Z + local commit
2024-12-18T00:11:52.7533328Z ++ get_pinned_commit vision
2024-12-18T00:11:52.7533729Z ++ cat .github/ci_commit_pins/vision.txt
2024-12-18T00:11:52.7547113Z + commit=d23a6e1664d20707c11781299611436e1f0c104f
2024-12-18T00:11:52.7547572Z + orig_preload=
2024-12-18T00:11:52.7547899Z + '[' -n '' ']'
2024-12-18T00:11:52.7548623Z + pip_install --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f
2024-12-18T00:11:52.7549510Z + pip_install_pkg='python3 -m pip install --progress-bar off'
2024-12-18T00:11:52.7550535Z + python3 -m pip install --progress-bar off --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f
2024-12-18T00:11:53.2101352Z Collecting git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f
2024-12-18T00:11:53.2108353Z   Cloning https://github.com/pytorch/vision.git (to revision d23a6e1664d20707c11781299611436e1f0c104f) to /tmp/pip-req-build-ck4xgdzt
2024-12-18T00:11:53.2136753Z   Running command git clone --filter=blob:none --quiet https://github.com/pytorch/vision.git /tmp/pip-req-build-ck4xgdzt
2024-12-18T00:11:54.8986527Z   Running command git rev-parse -q --verify 'sha^d23a6e1664d20707c11781299611436e1f0c104f'
2024-12-18T00:11:54.9014311Z   Running command git fetch -q https://github.com/pytorch/vision.git d23a6e1664d20707c11781299611436e1f0c104f
2024-12-18T00:11:56.6422461Z   Running command git checkout -q d23a6e1664d20707c11781299611436e1f0c104f
2024-12-18T00:11:57.0007732Z   Resolved https://github.com/pytorch/vision.git to commit d23a6e1664d20707c11781299611436e1f0c104f
2024-12-18T00:12:00.3384952Z   Preparing metadata (setup.py) ... [?25l- \ done
2024-12-18T00:12:00.3431492Z [?25hRequirement already satisfied: numpy in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (1.22.4)
2024-12-18T00:12:00.3437141Z Requirement already satisfied: torch in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (2.6.0a0+git0cdf8b1)
2024-12-18T00:12:00.3444303Z Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (11.0.0)
2024-12-18T00:12:00.3541447Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.16.1)
2024-12-18T00:12:00.3547941Z Requirement already satisfied: typing-extensions>=4.10.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (4.12.2)
2024-12-18T00:12:00.3553731Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2.8.8)
2024-12-18T00:12:00.3559500Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.1.4)
2024-12-18T00:12:00.3565018Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2024.10.0)
2024-12-18T00:12:00.3573573Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (1.13.1)
2024-12-18T00:12:00.3596032Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch->torchvision==0.19.0a0+d23a6e1) (1.3.0)
2024-12-18T00:12:00.4244891Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch->torchvision==0.19.0a0+d23a6e1) (3.0.2)
2024-12-18T00:12:00.4337529Z Building wheels for collected packages: torchvision
2024-12-18T00:13:47.5328618Z   Building wheel for torchvision (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / done
2024-12-18T00:13:47.5413159Z [?25h  Created wheel for torchvision: filename=torchvision-0.19.0a0+d23a6e1-cp310-cp310-linux_x86_64.whl size=2124106 sha256=7017e491e7c26bcc2b568fb40c24d6c5a50a564bcb15caaa750f941ed3f367c5
2024-12-18T00:13:47.5416672Z   Stored in directory: /var/lib/jenkins/.cache/pip/wheels/0e/56/35/02931e71eb23fd2b85591c7ec05b733ca7c8b328a2fd151f96
2024-12-18T00:13:47.5462295Z Successfully built torchvision
2024-12-18T00:13:47.9419685Z Installing collected packages: torchvision
2024-12-18T00:13:48.5130591Z Successfully installed torchvision-0.19.0a0+d23a6e1
2024-12-18T00:13:48.6567370Z + '[' -n '' ']'
2024-12-18T00:13:48.6567759Z + test_python_shard 4
2024-12-18T00:13:48.6568098Z + [[ -z 5 ]]
2024-12-18T00:13:48.6568921Z + python test/run_test.py --exclude-jit-executor --exclude-distributed-tests --shard 4 5 --verbose --upload-artifacts-while-running
2024-12-18T00:13:48.7984702Z /var/lib/jenkins/workspace/test/run_test.py:22: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
2024-12-18T00:13:48.7985809Z   import pkg_resources
2024-12-18T00:13:54.9044427Z Downloading https://ossci-metrics.s3.amazonaws.com/disabled-tests-condensed.json?versionId=PhiMB7EP3187qvpKvnORewoK3InOIvX5 to /var/lib/jenkins/workspace/test/.pytorch-disabled-tests.json
2024-12-18T00:13:54.9797539Z Ignoring disabled issues:  ['']
2024-12-18T00:13:55.0002616Z Found test times from artifacts
2024-12-18T00:13:55.0802544Z Found test times from artifacts
2024-12-18T00:13:55.0829486Z Running all tests
2024-12-18T00:13:55.1408873Z Running parallel tests on 2 processes
2024-12-18T00:13:55.1420993Z Name: tests to run (est. time: 123.96min)
2024-12-18T00:13:55.1421510Z   Serial tests (0):
2024-12-18T00:13:55.1421855Z   Parallel tests (123):
2024-12-18T00:13:55.1422219Z     test_nestedtensor 1/1
2024-12-18T00:13:55.1422578Z     dynamo/test_after_aot 1/1
2024-12-18T00:13:55.1422995Z     inductor/test_cpu_repro 1/6
2024-12-18T00:13:55.1423406Z     dynamo/test_higher_order_ops 1/1
2024-12-18T00:13:55.1423824Z     dynamo/test_repros 1/1
2024-12-18T00:13:55.1424210Z     inductor/test_inductor_freezing 1/1
2024-12-18T00:13:55.1424621Z     dynamo/test_backends 1/1
2024-12-18T00:13:55.1425008Z     inductor/test_mmdecomp 1/1
2024-12-18T00:13:55.1425382Z     dynamo/test_misc 1/1
2024-12-18T00:13:55.1425737Z     dynamo/test_logging 1/1
2024-12-18T00:13:55.1426132Z     inductor/test_compiled_autograd 2/3
2024-12-18T00:13:55.1426554Z     inductor/test_cpu_cpp_wrapper 1/1
2024-12-18T00:13:55.1426997Z     inductor/test_aot_inductor_arrayref 3/5
2024-12-18T00:13:55.1427458Z     torch_np/test_binary_ufuncs 1/1
2024-12-18T00:13:55.1427918Z     export/test_export_training_ir_to_run_decomp 1/1
2024-12-18T00:13:55.1428392Z     inductor/test_smoke 1/1
2024-12-18T00:13:55.1428773Z     export/test_unflatten_training_ir 1/1
2024-12-18T00:13:55.1429207Z     inductor/test_config 1/1
2024-12-18T00:13:55.1429601Z     inductor/test_debug_trace 1/1
2024-12-18T00:13:55.1430025Z     inductor/test_external_callables 1/1
2024-12-18T00:13:55.1430475Z     inductor/test_mkldnn_pattern_matcher 1/2
2024-12-18T00:13:55.1430901Z     inductor/test_inductor_utils 1/1
2024-12-18T00:13:55.1431334Z     inductor/test_torchinductor_opinfo 1/1
2024-12-18T00:13:55.1431791Z     inductor/test_compiled_optimizers 1/1
2024-12-18T00:13:55.1432224Z     dynamo/test_base_output 1/1
2024-12-18T00:13:55.1432640Z     inductor/test_cooperative_reductions 1/1
2024-12-18T00:13:55.1433062Z     test_import_stats 1/1
2024-12-18T00:13:55.1433424Z     test_binary_ufuncs 1/1
2024-12-18T00:13:55.1434927Z     inductor/test_pad_mm 1/1
2024-12-18T00:13:55.1435397Z     inductor/test_torchinductor_codegen_dynamic_shapes 3/5
2024-12-18T00:13:55.1435945Z     inductor/test_torchinductor_dynamic_shapes 3/5
2024-12-18T00:13:55.1436398Z     dynamo/test_fx_passes_pre_grad 1/1
2024-12-18T00:13:55.1436867Z     dynamo/test_cudagraphs_expandable_segments 1/1
2024-12-18T00:13:55.1437507Z     dynamo/test_modules 1/1
2024-12-18T00:13:55.1437916Z     inductor/test_combo_kernels 1/1
2024-12-18T00:13:55.1438331Z     dynamo/test_skip_non_tensor 1/1
2024-12-18T00:13:55.1438714Z     functorch/test_ops 1/9
2024-12-18T00:13:55.1439079Z     functorch/test_ops 6/9
2024-12-18T00:13:55.1439444Z     functorch/test_ops 9/9
2024-12-18T00:13:55.1439843Z     inductor/test_coordinate_descent_tuner 1/1
2024-12-18T00:13:55.1440275Z     xpu/test_conv 1/1
2024-12-18T00:13:55.1440611Z     inductor/test_multi_kernel 1/1
2024-12-18T00:13:55.1441014Z     test_ops_fwd_gradients 2/3
2024-12-18T00:13:55.1441426Z     dynamo/test_backward_higher_order_ops 1/1
2024-12-18T00:13:55.1441888Z     inductor/test_inplacing_pass 1/1
2024-12-18T00:13:55.1442293Z     dynamo/test_sources 1/1
2024-12-18T00:13:55.1442654Z     dynamo/test_model_output 1/1
2024-12-18T00:13:55.1443054Z     inductor/test_memory_planning 1/1
2024-12-18T00:13:55.1443486Z     higher_order_ops/test_with_effects 1/1
2024-12-18T00:13:55.1443918Z     export/test_passes 1/1
2024-12-18T00:13:55.1444303Z     dynamo/test_structured_trace 1/1
2024-12-18T00:13:55.1444791Z     inductor/test_torchinductor_codegen_config_overrides 1/1
2024-12-18T00:13:55.1445305Z     dynamo/test_decorators 1/1
2024-12-18T00:13:55.1445686Z     lazy/test_ts_opinfo 1/1
2024-12-18T00:13:55.1446069Z     inductor/test_fused_attention 1/1
2024-12-18T00:13:55.1446496Z     inductor/test_unbacked_symints 1/1
2024-12-18T00:13:55.1446888Z     test_ops_jit 2/2
2024-12-18T00:13:55.1447223Z     test_ops 3/12
2024-12-18T00:13:55.1447543Z     test_ops 9/12
2024-12-18T00:13:55.1447856Z     test_ops 12/12
2024-12-18T00:13:55.1448166Z     lazy/test_bindings 1/1
2024-12-18T00:13:55.1448548Z     test_expanded_weights 1/1
2024-12-18T00:13:55.1448940Z     test_compile_benchmark_util 1/1
2024-12-18T00:13:55.1449409Z     torch_np/numpy_tests/core/test_scalarinherit 1/1
2024-12-18T00:13:55.1449864Z     test_openmp 1/1
2024-12-18T00:13:55.1450193Z     profiler/test_profiler 1/1
2024-12-18T00:13:55.1450582Z     torch_np/test_random 1/1
2024-12-18T00:13:55.1450968Z     test_functionalization 1/1
2024-12-18T00:13:55.1451357Z     test_proxy_tensor 1/1
2024-12-18T00:13:55.1451723Z     torch_np/test_basic 1/1
2024-12-18T00:13:55.1452067Z     test_complex 1/1
2024-12-18T00:13:55.1452421Z     test_tensorexpr_pybind 1/1
2024-12-18T00:13:55.1452796Z     test_type_hints 1/1
2024-12-18T00:13:55.1453163Z     functorch/test_minifier 1/1
2024-12-18T00:13:55.1453546Z     test_jiterator 1/1
2024-12-18T00:13:55.1453915Z     torch_np/numpy_tests/core/test_numeric 1/1
2024-12-18T00:13:55.1454362Z     test_per_overload_api 1/1
2024-12-18T00:13:55.1454746Z     test_numpy_interop 1/1
2024-12-18T00:13:55.1455132Z     nn/test_multihead_attention 1/1
2024-12-18T00:13:55.1455553Z     test_fx_experimental 1/1
2024-12-18T00:13:55.1455919Z     functorch/test_logging 1/1
2024-12-18T00:13:55.1456795Z     test_native_functions 1/1
2024-12-18T00:13:55.1457187Z     functorch/test_control_flow 1/1
2024-12-18T00:13:55.1457595Z     torch_np/test_ufuncs_basic 1/1
2024-12-18T00:13:55.1458008Z     nn/test_packed_sequence 1/1
2024-12-18T00:13:55.1458378Z     test_sympy_utils 1/1
2024-12-18T00:13:55.1458770Z     test_set_default_mobile_cpu_allocator 1/1
2024-12-18T00:13:55.1459222Z     test_sparse_semi_structured 1/1
2024-12-18T00:13:55.1459717Z     nn/test_parametrization 1/1
2024-12-18T00:13:55.1460113Z     functorch/test_vmap 1/1
2024-12-18T00:13:55.1460491Z     test_decomp 6/25
2024-12-18T00:13:55.1460854Z     test_decomp 10/25
2024-12-18T00:13:55.1461179Z     test_decomp 16/25
2024-12-18T00:13:55.1461518Z     test_decomp 20/25
2024-12-18T00:13:55.1461864Z     test_flop_counter 1/1
2024-12-18T00:13:55.1462417Z     test_bundled_inputs 1/1
2024-12-18T00:13:55.1462801Z     test_numba_integration 1/1
2024-12-18T00:13:55.1463156Z     test_itt 1/1
2024-12-18T00:13:55.1463499Z     profiler/test_profiler_tree 1/1
2024-12-18T00:13:55.1463953Z     torch_np/numpy_tests/core/test_shape_base 1/1
2024-12-18T00:13:55.1464453Z     torch_np/numpy_tests/core/test_scalarmath 1/1
2024-12-18T00:13:55.1465034Z     test_fx_reinplace_pass 1/1
2024-12-18T00:13:55.1465426Z     functorch/test_dims 1/1
2024-12-18T00:13:55.1465796Z     test_fx_passes 1/1
2024-12-18T00:13:55.1466148Z     test_segment_reductions 1/1
2024-12-18T00:13:55.1466583Z     torch_np/numpy_tests/core/test_multiarray 1/1
2024-12-18T00:13:55.1467031Z     test_legacy_vmap 1/1
2024-12-18T00:13:55.1467367Z     test_subclass 1/1
2024-12-18T00:13:55.1467753Z     torch_np/numpy_tests/linalg/test_linalg 1/1
2024-12-18T00:13:55.1468186Z     test_dlpack 1/1
2024-12-18T00:13:55.1468521Z     nn/test_embedding 1/1
2024-12-18T00:13:55.1468923Z     torch_np/numpy_tests/lib/test_type_check 1/1
2024-12-18T00:13:55.1469349Z     test_masked 1/1
2024-12-18T00:13:55.1469670Z     test_jit 1/1
2024-12-18T00:13:55.1470031Z     torch_np/numpy_tests/core/test_indexing 1/1
2024-12-18T00:13:55.1470496Z     functorch/test_vmap_registrations 1/1
2024-12-18T00:13:55.1470929Z     profiler/test_memory_profiler 1/1
2024-12-18T00:13:55.1471340Z     test_maskedtensor 1/1
2024-12-18T00:13:55.1471709Z     nn/test_dropout 1/1
2024-12-18T00:13:55.1472049Z     test_meta 1/4
2024-12-18T00:13:55.1472375Z     test_quantization 1/3
2024-12-18T00:13:55.1472723Z     test_quantization 2/3
2024-12-18T00:13:55.1473091Z     optim/test_lrscheduler 1/1
2024-12-18T00:13:55.1473483Z Name: excluded (est. time: 0.0min)
2024-12-18T00:13:55.1473874Z   Serial tests (0):
2024-12-18T00:13:55.1474207Z   Parallel tests (0):
2024-12-18T00:13:55.1524846Z Running test_nestedtensor 1/1 ... [2024-12-18 00:13:55.152016]
2024-12-18T00:13:55.1525902Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:13:55.1530694Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_nestedtensor.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:13:55.152531]
2024-12-18T00:14:02.7338454Z 
2024-12-18T00:14:02.7339915Z test_nestedtensor 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_nestedtensor_1.1_1fb279556bdb67aa_.log
2024-12-18T00:14:02.7340834Z Running 0 items in this shard:
2024-12-18T00:14:02.7341113Z 
2024-12-18T00:14:02.7345403Z Running dynamo/test_after_aot 1/1 ... [2024-12-18 00:14:02.734256]
2024-12-18T00:14:02.7345963Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:14:02.7350706Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'dynamo/test_after_aot.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:14:02.734719]
2024-12-18T00:14:07.8103427Z 
2024-12-18T00:14:07.8104594Z dynamo/test_after_aot 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_after_aot_1.1_84b91c04d100363e_.log
2024-12-18T00:14:07.8105556Z Running 0 items in this shard:
2024-12-18T00:14:07.8105839Z 
2024-12-18T00:14:07.8108797Z Running inductor/test_cpu_repro 1/6 ... [2024-12-18 00:14:07.810552]
2024-12-18T00:14:07.8109391Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:14:07.8114169Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_cpu_repro.py', '-m', 'serial', '--shard-id=1', '--num-shards=6', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:14:07.811044]
2024-12-18T00:14:19.7508598Z 
2024-12-18T00:14:19.7509881Z inductor/test_cpu_repro 1/6 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_cpu_repro_1.6_b2a7f12a100cbcd6_.log
2024-12-18T00:14:19.7511238Z Running 0 items in this shard:
2024-12-18T00:14:19.7511535Z 
2024-12-18T00:14:19.7514509Z Running dynamo/test_higher_order_ops 1/1 ... [2024-12-18 00:14:19.751076]
2024-12-18T00:14:19.7515105Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:14:19.7519779Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'dynamo/test_higher_order_ops.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:14:19.751585]
2024-12-18T00:14:25.0269307Z 
2024-12-18T00:14:25.0270727Z dynamo/test_higher_order_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_higher_order_ops_1.1_4ae0c3cf9da56218_.log
2024-12-18T00:14:25.0271769Z Running 0 items in this shard:
2024-12-18T00:14:25.0272046Z 
2024-12-18T00:14:25.0274889Z Running dynamo/test_repros 1/1 ... [2024-12-18 00:14:25.027171]
2024-12-18T00:14:25.0275474Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:14:25.0280026Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'dynamo/test_repros.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:14:25.027646]
2024-12-18T00:14:30.6541674Z 
2024-12-18T00:14:30.6542985Z dynamo/test_repros 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_repros_1.1_e6be38e01799197e_.log
2024-12-18T00:14:30.6543915Z Running 0 items in this shard:
2024-12-18T00:14:30.6544174Z 
2024-12-18T00:14:30.6548214Z Running inductor/test_inductor_freezing 1/1 ... [2024-12-18 00:14:30.654461]
2024-12-18T00:14:30.6548828Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:14:30.6553385Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_inductor_freezing.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:14:30.654964]
2024-12-18T00:14:39.6893260Z 
2024-12-18T00:14:39.6894702Z inductor/test_inductor_freezing 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_inductor_freezing_1.1_1f69fb860e28eebd_.log
2024-12-18T00:14:39.6895809Z Running 0 items in this shard:
2024-12-18T00:14:39.6896079Z 
2024-12-18T00:14:39.6899132Z Running dynamo/test_backends 1/1 ... [2024-12-18 00:14:39.689586]
2024-12-18T00:14:39.6899696Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:14:39.6904292Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'dynamo/test_backends.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:14:39.690065]
2024-12-18T00:14:44.8153577Z 
2024-12-18T00:14:44.8156526Z dynamo/test_backends 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_backends_1.1_1ca24bd5a3748e69_.log
2024-12-18T00:14:44.8158981Z Running 0 items in this shard:
2024-12-18T00:14:44.8159586Z 
2024-12-18T00:14:44.8165075Z Running inductor/test_mmdecomp 1/1 ... [2024-12-18 00:14:44.816068]
2024-12-18T00:14:44.8166385Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:14:44.8177152Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_mmdecomp.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:14:44.817009]
2024-12-18T00:14:50.3971475Z 
2024-12-18T00:14:50.3972745Z inductor/test_mmdecomp 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_mmdecomp_1.1_4ac1d8787bea9e04_.log
2024-12-18T00:14:50.3973743Z Running 0 items in this shard:
2024-12-18T00:14:50.3974007Z 
2024-12-18T00:14:50.3976402Z Running dynamo/test_misc 1/1 ... [2024-12-18 00:14:50.397338]
2024-12-18T00:14:50.3977009Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:14:50.3982091Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'dynamo/test_misc.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:14:50.397776]
2024-12-18T00:14:57.3765527Z 
2024-12-18T00:14:57.3766576Z dynamo/test_misc 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_misc_1.1_bb4590769846e7bc_.log
2024-12-18T00:14:57.3767456Z Running 0 items in this shard:
2024-12-18T00:14:57.3767732Z 
2024-12-18T00:14:57.3770710Z Running dynamo/test_logging 1/1 ... [2024-12-18 00:14:57.376770]
2024-12-18T00:14:57.3771271Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:14:57.3775709Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'dynamo/test_logging.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:14:57.377220]
2024-12-18T00:15:02.6024233Z 
2024-12-18T00:15:02.6025329Z dynamo/test_logging 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_logging_1.1_5d3eec82fa8550b0_.log
2024-12-18T00:15:02.6026249Z Running 0 items in this shard:
2024-12-18T00:15:02.6026526Z 
2024-12-18T00:15:02.6029738Z Running inductor/test_compiled_autograd 2/3 ... [2024-12-18 00:15:02.602645]
2024-12-18T00:15:02.6030346Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:15:02.6034581Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_compiled_autograd.py', '-m', 'serial', '--shard-id=2', '--num-shards=3', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:15:02.603088]
2024-12-18T00:15:12.4880149Z 
2024-12-18T00:15:12.4881363Z inductor/test_compiled_autograd 2/3 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_compiled_autograd_2.3_3c6cdba1e8bb43f1_.log
2024-12-18T00:15:12.4882454Z Running 0 items in this shard:
2024-12-18T00:15:12.4882711Z 
2024-12-18T00:15:12.4886475Z Running inductor/test_cpu_cpp_wrapper 1/1 ... [2024-12-18 00:15:12.488261]
2024-12-18T00:15:12.4887075Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:15:12.4892210Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_cpu_cpp_wrapper.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:15:12.488798]
2024-12-18T00:15:21.7153464Z 
2024-12-18T00:15:21.7154626Z inductor/test_cpu_cpp_wrapper 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_cpu_cpp_wrapper_1.1_47b3c7d173be9bd4_.log
2024-12-18T00:15:21.7155532Z 
2024-12-18T00:15:21.7160353Z Running inductor/test_aot_inductor_arrayref 3/5 ... [2024-12-18 00:15:21.715661]
2024-12-18T00:15:21.7160967Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:15:21.7166520Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_aot_inductor_arrayref.py', '-m', 'serial', '--shard-id=3', '--num-shards=5', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:15:21.716199]
2024-12-18T00:15:30.8982838Z 
2024-12-18T00:15:30.8984114Z inductor/test_aot_inductor_arrayref 3/5 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_aot_inductor_arrayref_3.5_761c78e4de41f2ad_.log
2024-12-18T00:15:30.8985205Z Running 0 items in this shard:
2024-12-18T00:15:30.8985472Z 
2024-12-18T00:15:30.8989367Z Running torch_np/test_binary_ufuncs 1/1 ... [2024-12-18 00:15:30.898558]
2024-12-18T00:15:30.8990218Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:15:30.8995237Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'torch_np/test_binary_ufuncs.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:15:30.899122]
2024-12-18T00:15:35.9740342Z 
2024-12-18T00:15:35.9741815Z torch_np/test_binary_ufuncs 1/1 was successful, full logs can be found in artifacts with path test/test-reports/torch_np.test_binary_ufuncs_1.1_3ad1200bd6dbcf6c_.log
2024-12-18T00:15:35.9742866Z Running 0 items in this shard:
2024-12-18T00:15:35.9743145Z 
2024-12-18T00:15:35.9746154Z Running export/test_export_training_ir_to_run_decomp 1/1 ... [2024-12-18 00:15:35.974295]
2024-12-18T00:15:35.9746815Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:15:35.9751099Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'export/test_export_training_ir_to_run_decomp.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:15:35.974748]
2024-12-18T00:15:42.5031091Z 
2024-12-18T00:15:42.5032576Z export/test_export_training_ir_to_run_decomp 1/1 was successful, full logs can be found in artifacts with path test/test-reports/export.test_export_training_ir_to_run_decomp_1.1_777563bfe24ff4a0_.log
2024-12-18T00:15:42.5033750Z Running 0 items in this shard:
2024-12-18T00:15:42.5034024Z 
2024-12-18T00:15:42.5036532Z Running inductor/test_smoke 1/1 ... [2024-12-18 00:15:42.503301]
2024-12-18T00:15:42.5037343Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:15:42.5042224Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_smoke.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:15:42.503818]
2024-12-18T00:15:47.5815328Z 
2024-12-18T00:15:47.5816609Z inductor/test_smoke 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_smoke_1.1_78394ba4c34709e2_.log
2024-12-18T00:15:47.5817393Z 
2024-12-18T00:15:47.5827178Z Running export/test_unflatten_training_ir 1/1 ... [2024-12-18 00:15:47.582189]
2024-12-18T00:15:47.5827819Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:15:47.5833450Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'export/test_unflatten_training_ir.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:15:47.582916]
2024-12-18T00:15:52.8090411Z 
2024-12-18T00:15:52.8091518Z export/test_unflatten_training_ir 1/1 was successful, full logs can be found in artifacts with path test/test-reports/export.test_unflatten_training_ir_1.1_1d1025b2191ef7a5_.log
2024-12-18T00:15:52.8092580Z Running 0 items in this shard:
2024-12-18T00:15:52.8092870Z 
2024-12-18T00:15:52.8095903Z Running inductor/test_config 1/1 ... [2024-12-18 00:15:52.809297]
2024-12-18T00:15:52.8096445Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:15:52.8100851Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_config.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:15:52.809747]
2024-12-18T00:16:00.2382410Z 
2024-12-18T00:16:00.2383461Z inductor/test_config 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_config_1.1_f5f740f3c13f47ad_.log
2024-12-18T00:16:00.2385403Z Running 0 items in this shard:
2024-12-18T00:16:00.2385716Z 
2024-12-18T00:16:00.2388120Z Running inductor/test_debug_trace 1/1 ... [2024-12-18 00:16:00.238468]
2024-12-18T00:16:00.2388704Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:16:00.2393488Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_debug_trace.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:16:00.238987]
2024-12-18T00:16:09.5245928Z 
2024-12-18T00:16:09.5247829Z inductor/test_debug_trace 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_debug_trace_1.1_a6dc36c52c6d15de_.log
2024-12-18T00:16:09.5249083Z Running 0 items in this shard:
2024-12-18T00:16:09.5249500Z 
2024-12-18T00:16:09.5252054Z Running inductor/test_external_callables 1/1 ... [2024-12-18 00:16:09.524860]
2024-12-18T00:16:09.5252664Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:16:09.5258869Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_external_callables.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:16:09.525403]
2024-12-18T00:16:14.8506618Z 
2024-12-18T00:16:14.8507794Z inductor/test_external_callables 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_external_callables_1.1_eb7c63899e6873f5_.log
2024-12-18T00:16:14.8508861Z Running 0 items in this shard:
2024-12-18T00:16:14.8511801Z 
2024-12-18T00:16:14.8512417Z Running inductor/test_mkldnn_pattern_matcher 1/2 ... [2024-12-18 00:16:14.850916]
2024-12-18T00:16:14.8513041Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:16:14.8518126Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_mkldnn_pattern_matcher.py', '-m', 'serial', '--shard-id=1', '--num-shards=2', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:16:14.851435]
2024-12-18T00:16:22.8321301Z 
2024-12-18T00:16:22.8323434Z inductor/test_mkldnn_pattern_matcher 1/2 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_mkldnn_pattern_matcher_1.2_a30876f2770622bf_.log
2024-12-18T00:16:22.8325652Z Running 0 items in this shard:
2024-12-18T00:16:22.8326141Z 
2024-12-18T00:16:22.8326939Z Running inductor/test_inductor_utils 1/1 ... [2024-12-18 00:16:22.832366]
2024-12-18T00:16:22.8327565Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:16:22.8332376Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_inductor_utils.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:16:22.832871]
2024-12-18T00:16:27.9590313Z 
2024-12-18T00:16:27.9591702Z inductor/test_inductor_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_inductor_utils_1.1_5143e59a70fcd1a1_.log
2024-12-18T00:16:27.9592740Z Running 0 items in this shard:
2024-12-18T00:16:27.9593025Z 
2024-12-18T00:16:27.9597027Z Running inductor/test_torchinductor_opinfo 1/1 ... [2024-12-18 00:16:27.959377]
2024-12-18T00:16:27.9597659Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:16:27.9602902Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor_opinfo.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:16:27.959914]
2024-12-18T00:16:39.2478474Z 
2024-12-18T00:16:39.2479857Z inductor/test_torchinductor_opinfo 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_opinfo_1.1_ce0b4de2e239d679_.log
2024-12-18T00:16:39.2480959Z Running 0 items in this shard:
2024-12-18T00:16:39.2481218Z 
2024-12-18T00:16:39.2487537Z Running inductor/test_compiled_optimizers 1/1 ... [2024-12-18 00:16:39.248121]
2024-12-18T00:16:39.2488536Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:16:39.2490642Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_compiled_optimizers.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:16:39.248616]
2024-12-18T00:16:49.7346985Z 
2024-12-18T00:16:49.7348728Z inductor/test_compiled_optimizers 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_compiled_optimizers_1.1_e8c91d041d02e2a6_.log
2024-12-18T00:16:49.7349870Z Running 0 items in this shard:
2024-12-18T00:16:49.7350121Z 
2024-12-18T00:16:49.7352623Z Running dynamo/test_base_output 1/1 ... [2024-12-18 00:16:49.734943]
2024-12-18T00:16:49.7353305Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:16:49.7358568Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'dynamo/test_base_output.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:16:49.735438]
2024-12-18T00:16:54.6595544Z 
2024-12-18T00:16:54.6596801Z dynamo/test_base_output 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_base_output_1.1_434c22ee80573fe6_.log
2024-12-18T00:16:54.6597753Z Running 0 items in this shard:
2024-12-18T00:16:54.6598070Z 
2024-12-18T00:16:54.6601893Z Running inductor/test_cooperative_reductions 1/1 ... [2024-12-18 00:16:54.659824]
2024-12-18T00:16:54.6602829Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:16:54.6607115Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_cooperative_reductions.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:16:54.660318]
2024-12-18T00:17:00.2777260Z 
2024-12-18T00:17:00.2778606Z inductor/test_cooperative_reductions 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_cooperative_reductions_1.1_2134be1987884d0f_.log
2024-12-18T00:17:00.2779612Z 
2024-12-18T00:17:00.2787113Z Running test_import_stats 1/1 ... [2024-12-18 00:17:00.278367]
2024-12-18T00:17:00.2787650Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:17:00.2794212Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_import_stats.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:17:00.279079]
2024-12-18T00:17:05.5059508Z 
2024-12-18T00:17:05.5060886Z test_import_stats 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_import_stats_1.1_3d21c0f9fb6b5a66_.log
2024-12-18T00:17:05.5061811Z Running 0 items in this shard:
2024-12-18T00:17:05.5062090Z 
2024-12-18T00:17:05.5065660Z Running test_binary_ufuncs 1/1 ... [2024-12-18 00:17:05.506246]
2024-12-18T00:17:05.5066256Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:17:05.5071251Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_binary_ufuncs.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:17:05.506754]
2024-12-18T00:17:15.6420821Z 
2024-12-18T00:17:15.6421854Z test_binary_ufuncs 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_binary_ufuncs_1.1_b37f78439ef8c1b3_.log
2024-12-18T00:17:15.6422772Z Running 0 items in this shard:
2024-12-18T00:17:15.6423054Z 
2024-12-18T00:17:15.6426707Z Running inductor/test_pad_mm 1/1 ... [2024-12-18 00:17:15.642370]
2024-12-18T00:17:15.6427303Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:17:15.6432718Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_pad_mm.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:17:15.642881]
2024-12-18T00:17:21.4218603Z 
2024-12-18T00:17:21.4219850Z inductor/test_pad_mm 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_pad_mm_1.1_706a21ae5df1fcfc_.log
2024-12-18T00:17:21.4220734Z 
2024-12-18T00:17:21.4225316Z Running inductor/test_torchinductor_codegen_dynamic_shapes 3/5 ... [2024-12-18 00:17:21.422089]
2024-12-18T00:17:21.4226086Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:17:21.4230207Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor_codegen_dynamic_shapes.py', '-m', 'serial', '--shard-id=3', '--num-shards=5', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:17:21.422602]
2024-12-18T00:18:02.2747231Z 
2024-12-18T00:18:02.2751371Z inductor/test_torchinductor_codegen_dynamic_shapes 3/5 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_codegen_dynamic_shapes_3.5_0702f0c149918d13_.log
2024-12-18T00:18:02.2753323Z Running 1 items in this shard: test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_large_block_sizes_dynamic_shapes_cpu
2024-12-18T00:18:02.2754179Z 
2024-12-18T00:18:02.2755269Z Running inductor/test_torchinductor_dynamic_shapes 3/5 ... [2024-12-18 00:18:02.275168]
2024-12-18T00:18:02.2755921Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:18:02.2762491Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor_dynamic_shapes.py', '-m', 'serial', '--shard-id=3', '--num-shards=5', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:18:02.275839]
2024-12-18T00:18:38.2681786Z 
2024-12-18T00:18:38.2683338Z inductor/test_torchinductor_dynamic_shapes 3/5 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_dynamic_shapes_3.5_e5399db5092c7112_.log
2024-12-18T00:18:38.2685090Z Running 1 items in this shard: test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_large_block_sizes_dynamic_shapes_cpu
2024-12-18T00:18:38.2685896Z 
2024-12-18T00:18:38.2687469Z Running dynamo/test_fx_passes_pre_grad 1/1 ... [2024-12-18 00:18:38.268408]
2024-12-18T00:18:38.2688060Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:18:38.2692672Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'dynamo/test_fx_passes_pre_grad.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:18:38.268889]
2024-12-18T00:18:43.3951275Z 
2024-12-18T00:18:43.3952607Z dynamo/test_fx_passes_pre_grad 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_fx_passes_pre_grad_1.1_1d30575f50927a4a_.log
2024-12-18T00:18:43.3953670Z Running 0 items in this shard:
2024-12-18T00:18:43.3953954Z 
2024-12-18T00:18:43.3957334Z Running dynamo/test_cudagraphs_expandable_segments 1/1 ... [2024-12-18 00:18:43.395317]
2024-12-18T00:18:43.3958035Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:18:43.3963332Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'dynamo/test_cudagraphs_expandable_segments.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:18:43.395829]
2024-12-18T00:18:48.8217670Z 
2024-12-18T00:18:48.8219598Z dynamo/test_cudagraphs_expandable_segments 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_cudagraphs_expandable_segments_1.1_eeb454191ffa3761_.log
2024-12-18T00:18:48.8220775Z Running 0 items in this shard:
2024-12-18T00:18:48.8221033Z 
2024-12-18T00:18:48.8223963Z Running dynamo/test_modules 1/1 ... [2024-12-18 00:18:48.822047]
2024-12-18T00:18:48.8225089Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:18:48.8229435Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'dynamo/test_modules.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:18:48.822518]
2024-12-18T00:18:54.6496282Z 
2024-12-18T00:18:54.6497638Z dynamo/test_modules 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_modules_1.1_1cd1cafc23a509f7_.log
2024-12-18T00:18:54.6498599Z Running 0 items in this shard:
2024-12-18T00:18:54.6498860Z 
2024-12-18T00:18:54.6502708Z Running inductor/test_combo_kernels 1/1 ... [2024-12-18 00:18:54.649958]
2024-12-18T00:18:54.6503582Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:18:54.6508891Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_combo_kernels.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:18:54.650498]
2024-12-18T00:19:03.8846389Z 
2024-12-18T00:19:03.8847973Z inductor/test_combo_kernels 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_combo_kernels_1.1_f5045828aced9592_.log
2024-12-18T00:19:03.8849275Z Running 0 items in this shard:
2024-12-18T00:19:03.8849766Z 
2024-12-18T00:19:03.8853198Z Running dynamo/test_skip_non_tensor 1/1 ... [2024-12-18 00:19:03.884946]
2024-12-18T00:19:03.8854032Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:19:03.8859229Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'dynamo/test_skip_non_tensor.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:19:03.885490]
2024-12-18T00:19:08.9605329Z 
2024-12-18T00:19:08.9606647Z dynamo/test_skip_non_tensor 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_skip_non_tensor_1.1_613ce9324d608f27_.log
2024-12-18T00:19:08.9607642Z Running 0 items in this shard:
2024-12-18T00:19:08.9607929Z 
2024-12-18T00:19:08.9610862Z Running functorch/test_ops 1/9 ... [2024-12-18 00:19:08.960771]
2024-12-18T00:19:08.9611414Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:19:08.9616479Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'functorch/test_ops.py', '-m', 'serial', '--shard-id=1', '--num-shards=9', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:19:08.961286]
2024-12-18T00:19:18.6959349Z 
2024-12-18T00:19:18.6962782Z functorch/test_ops 1/9 was successful, full logs can be found in artifacts with path test/test-reports/functorch.test_ops_1.9_21ce33665f4dd9ef_.log
2024-12-18T00:19:18.6964019Z Running 0 items in this shard:
2024-12-18T00:19:18.6964357Z 
2024-12-18T00:19:18.6965089Z Running functorch/test_ops 6/9 ... [2024-12-18 00:19:18.696181]
2024-12-18T00:19:18.6965682Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:19:18.6970702Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'functorch/test_ops.py', '-m', 'serial', '--shard-id=6', '--num-shards=9', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:19:18.696659]
2024-12-18T00:19:28.2797833Z 
2024-12-18T00:19:28.2799112Z functorch/test_ops 6/9 was successful, full logs can be found in artifacts with path test/test-reports/functorch.test_ops_6.9_1c2393d29ae8dd00_.log
2024-12-18T00:19:28.2800291Z Running 0 items in this shard:
2024-12-18T00:19:28.2800558Z 
2024-12-18T00:19:28.2803390Z Running functorch/test_ops 9/9 ... [2024-12-18 00:19:28.280026]
2024-12-18T00:19:28.2804167Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:19:28.2809051Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'functorch/test_ops.py', '-m', 'serial', '--shard-id=9', '--num-shards=9', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:19:28.280503]
2024-12-18T00:19:37.7626070Z 
2024-12-18T00:19:37.7627942Z functorch/test_ops 9/9 was successful, full logs can be found in artifacts with path test/test-reports/functorch.test_ops_9.9_7f82ca427dc50abd_.log
2024-12-18T00:19:37.7629152Z Running 0 items in this shard:
2024-12-18T00:19:37.7629454Z 
2024-12-18T00:19:37.7631401Z Running inductor/test_coordinate_descent_tuner 1/1 ... [2024-12-18 00:19:37.762810]
2024-12-18T00:19:37.7632049Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:19:37.7636853Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_coordinate_descent_tuner.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:19:37.763287]
2024-12-18T00:19:42.6878461Z 
2024-12-18T00:19:42.6879852Z inductor/test_coordinate_descent_tuner 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_coordinate_descent_tuner_1.1_8bf29587b2111dcb_.log
2024-12-18T00:19:42.6880839Z 
2024-12-18T00:19:42.6884283Z Running xpu/test_conv 1/1 ... [2024-12-18 00:19:42.688093]
2024-12-18T00:19:42.6884805Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:19:42.6890287Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'xpu/test_conv.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:19:42.688621]
2024-12-18T00:19:48.6175593Z 
2024-12-18T00:19:48.6176947Z xpu/test_conv 1/1 was successful, full logs can be found in artifacts with path test/test-reports/xpu.test_conv_1.1_c94b18558b8e8aef_.log
2024-12-18T00:19:48.6178119Z Running 0 items in this shard:
2024-12-18T00:19:48.6178579Z 
2024-12-18T00:19:48.6181208Z Running inductor/test_multi_kernel 1/1 ... [2024-12-18 00:19:48.617777]
2024-12-18T00:19:48.6182075Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:19:48.6187254Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_multi_kernel.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:19:48.618322]
2024-12-18T00:19:53.6814952Z 
2024-12-18T00:19:53.6816459Z inductor/test_multi_kernel 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_multi_kernel_1.1_24353616c70741fb_.log
2024-12-18T00:19:53.6817580Z 
2024-12-18T00:19:53.6820021Z Running test_ops_fwd_gradients 2/3 ... [2024-12-18 00:19:53.681678]
2024-12-18T00:19:53.6820635Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:19:53.6825618Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_ops_fwd_gradients.py', '-m', 'serial', '--shard-id=2', '--num-shards=3', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:19:53.682160]
2024-12-18T00:20:01.0623057Z 
2024-12-18T00:20:01.0624127Z test_ops_fwd_gradients 2/3 was successful, full logs can be found in artifacts with path test/test-reports/test_ops_fwd_gradients_2.3_909d12ed3d04a0ef_.log
2024-12-18T00:20:01.0625083Z Running 0 items in this shard:
2024-12-18T00:20:01.0625341Z 
2024-12-18T00:20:01.0628832Z Running dynamo/test_backward_higher_order_ops 1/1 ... [2024-12-18 00:20:01.062549]
2024-12-18T00:20:01.0629474Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:20:01.0634067Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'dynamo/test_backward_higher_order_ops.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:20:01.063053]
2024-12-18T00:20:06.1389808Z 
2024-12-18T00:20:06.1391886Z dynamo/test_backward_higher_order_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_backward_higher_order_ops_1.1_85467b1388af1957_.log
2024-12-18T00:20:06.1394461Z Running 0 items in this shard:
2024-12-18T00:20:06.1394970Z 
2024-12-18T00:20:06.1395598Z Running inductor/test_inplacing_pass 1/1 ... [2024-12-18 00:20:06.139217]
2024-12-18T00:20:06.1396620Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:20:06.1400469Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_inplacing_pass.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:20:06.139688]
2024-12-18T00:20:11.8723183Z 
2024-12-18T00:20:11.8724392Z inductor/test_inplacing_pass 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_inplacing_pass_1.1_89b1206b840529a2_.log
2024-12-18T00:20:11.8725305Z 
2024-12-18T00:20:11.8728932Z Running dynamo/test_sources 1/1 ... [2024-12-18 00:20:11.872552]
2024-12-18T00:20:11.8729479Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:20:11.8734375Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'dynamo/test_sources.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:20:11.873034]
2024-12-18T00:20:16.9483677Z 
2024-12-18T00:20:16.9484780Z dynamo/test_sources 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_sources_1.1_26b30c8446ad81dc_.log
2024-12-18T00:20:16.9485734Z Running 0 items in this shard:
2024-12-18T00:20:16.9485997Z 
2024-12-18T00:20:16.9488934Z Running dynamo/test_model_output 1/1 ... [2024-12-18 00:20:16.948567]
2024-12-18T00:20:16.9489562Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:20:16.9493954Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'dynamo/test_model_output.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:20:16.949021]
2024-12-18T00:20:22.4751875Z 
2024-12-18T00:20:22.4752954Z dynamo/test_model_output 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_model_output_1.1_348adc2038d47bcb_.log
2024-12-18T00:20:22.4753909Z Running 0 items in this shard:
2024-12-18T00:20:22.4754183Z 
2024-12-18T00:20:22.4757803Z Running inductor/test_memory_planning 1/1 ... [2024-12-18 00:20:22.475439]
2024-12-18T00:20:22.4758403Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:20:22.4763162Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_memory_planning.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:20:22.475946]
2024-12-18T00:20:27.4503810Z 
2024-12-18T00:20:27.4505166Z inductor/test_memory_planning 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_memory_planning_1.1_2d58cc95e3534a2e_.log
2024-12-18T00:20:27.4506066Z 
2024-12-18T00:20:27.4509162Z Running higher_order_ops/test_with_effects 1/1 ... [2024-12-18 00:20:27.450542]
2024-12-18T00:20:27.4509910Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:20:27.4514220Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'higher_order_ops/test_with_effects.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:20:27.451010]
2024-12-18T00:20:33.6289621Z 
2024-12-18T00:20:33.6291219Z higher_order_ops/test_with_effects 1/1 was successful, full logs can be found in artifacts with path test/test-reports/higher_order_ops.test_with_effects_1.1_0ffc1c7dcf4725d4_.log
2024-12-18T00:20:33.6292319Z Running 0 items in this shard:
2024-12-18T00:20:33.6292594Z 
2024-12-18T00:20:33.6296574Z Running export/test_passes 1/1 ... [2024-12-18 00:20:33.629259]
2024-12-18T00:20:33.6297483Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:20:33.6301789Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'export/test_passes.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:20:33.629790]
2024-12-18T00:20:40.1077248Z 
2024-12-18T00:20:40.1078473Z export/test_passes 1/1 was successful, full logs can be found in artifacts with path test/test-reports/export.test_passes_1.1_97a1e8dae0e2cd4a_.log
2024-12-18T00:20:40.1079417Z Running 0 items in this shard:
2024-12-18T00:20:40.1079724Z 
2024-12-18T00:20:40.1082999Z Running dynamo/test_structured_trace 1/1 ... [2024-12-18 00:20:40.107955]
2024-12-18T00:20:40.1083589Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:20:40.1088741Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'dynamo/test_structured_trace.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:20:40.108479]
2024-12-18T00:20:45.2838265Z 
2024-12-18T00:20:45.2839594Z dynamo/test_structured_trace 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_structured_trace_1.1_4847ecd074c0bcdc_.log
2024-12-18T00:20:45.2840620Z Running 0 items in this shard:
2024-12-18T00:20:45.2840894Z 
2024-12-18T00:20:45.2844803Z Running inductor/test_torchinductor_codegen_config_overrides 1/1 ... [2024-12-18 00:20:45.284090]
2024-12-18T00:20:45.2845524Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:20:45.2850421Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_torchinductor_codegen_config_overrides.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:20:45.284578]
2024-12-18T00:20:52.9656403Z 
2024-12-18T00:20:52.9659804Z inductor/test_torchinductor_codegen_config_overrides 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_codegen_config_overrides_1.1_adf57940164e45d5_.log
2024-12-18T00:20:52.9661102Z Running 0 items in this shard:
2024-12-18T00:20:52.9661377Z 
2024-12-18T00:20:52.9661650Z Running dynamo/test_decorators 1/1 ... [2024-12-18 00:20:52.965848]
2024-12-18T00:20:52.9662210Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:20:52.9667217Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'dynamo/test_decorators.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:20:52.966348]
2024-12-18T00:20:58.0412055Z 
2024-12-18T00:20:58.0413148Z dynamo/test_decorators 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_decorators_1.1_6967fe0dcc80b51a_.log
2024-12-18T00:20:58.0414160Z Running 0 items in this shard:
2024-12-18T00:20:58.0414427Z 
2024-12-18T00:20:58.0418271Z Running lazy/test_ts_opinfo 1/1 ... [2024-12-18 00:20:58.041516]
2024-12-18T00:20:58.0418789Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:20:58.0424166Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'lazy/test_ts_opinfo.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:20:58.042050]
2024-12-18T00:21:04.4192890Z 
2024-12-18T00:21:04.4194048Z lazy/test_ts_opinfo 1/1 was successful, full logs can be found in artifacts with path test/test-reports/lazy.test_ts_opinfo_1.1_c8079071021243d8_.log
2024-12-18T00:21:04.4195612Z Running 0 items in this shard:
2024-12-18T00:21:04.4196007Z 
2024-12-18T00:21:04.4198377Z Running inductor/test_fused_attention 1/1 ... [2024-12-18 00:21:04.419503]
2024-12-18T00:21:04.4199214Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:21:04.4203645Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_fused_attention.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:21:04.419957]
2024-12-18T00:21:12.2002040Z 
2024-12-18T00:21:12.2003225Z inductor/test_fused_attention 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_fused_attention_1.1_f3043d6260755358_.log
2024-12-18T00:21:12.2004278Z Running 0 items in this shard:
2024-12-18T00:21:12.2004856Z 
2024-12-18T00:21:12.2007820Z Running inductor/test_unbacked_symints 1/1 ... [2024-12-18 00:21:12.200427]
2024-12-18T00:21:12.2008426Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:21:12.2012897Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_unbacked_symints.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:21:12.200911]
2024-12-18T00:21:17.5780623Z 
2024-12-18T00:21:17.5782078Z inductor/test_unbacked_symints 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_unbacked_symints_1.1_8c9abebc8443ead9_.log
2024-12-18T00:21:17.5782986Z 
2024-12-18T00:21:17.5785738Z Running test_ops_jit 2/2 ... [2024-12-18 00:21:17.578240]
2024-12-18T00:21:17.5786242Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:21:17.5790823Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_ops_jit.py', '-m', 'serial', '--shard-id=2', '--num-shards=2', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:21:17.578689]
2024-12-18T00:21:24.5072911Z 
2024-12-18T00:21:24.5074171Z test_ops_jit 2/2 was successful, full logs can be found in artifacts with path test/test-reports/test_ops_jit_2.2_361db35190804d98_.log
2024-12-18T00:21:24.5075045Z Running 0 items in this shard:
2024-12-18T00:21:24.5075305Z 
2024-12-18T00:21:24.5078439Z Running test_ops 3/12 ... [2024-12-18 00:21:24.507523]
2024-12-18T00:21:24.5078955Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:21:24.5083628Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_ops.py', '-m', 'serial', '--shard-id=3', '--num-shards=12', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:21:24.507986]
2024-12-18T00:21:40.5034689Z 
2024-12-18T00:21:40.5035757Z test_ops 3/12 was successful, full logs can be found in artifacts with path test/test-reports/test_ops_3.12_95cee687f975e8f5_.log
2024-12-18T00:21:40.5036589Z Running 0 items in this shard:
2024-12-18T00:21:40.5036867Z 
2024-12-18T00:21:40.5040237Z Running test_ops 9/12 ... [2024-12-18 00:21:40.503675]
2024-12-18T00:21:40.5040746Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:21:40.5045350Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_ops.py', '-m', 'serial', '--shard-id=9', '--num-shards=12', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:21:40.504125]
2024-12-18T00:21:56.1997554Z 
2024-12-18T00:21:56.1998537Z test_ops 9/12 was successful, full logs can be found in artifacts with path test/test-reports/test_ops_9.12_9d2ad8f1115b0bd8_.log
2024-12-18T00:21:56.1999371Z Running 0 items in this shard:
2024-12-18T00:21:56.1999650Z 
2024-12-18T00:21:56.2004124Z Running test_ops 12/12 ... [2024-12-18 00:21:56.200073]
2024-12-18T00:21:56.2005039Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:21:56.2011094Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_ops.py', '-m', 'serial', '--shard-id=12', '--num-shards=12', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:21:56.200654]
2024-12-18T00:22:12.0969106Z 
2024-12-18T00:22:12.0973261Z test_ops 12/12 was successful, full logs can be found in artifacts with path test/test-reports/test_ops_12.12_d9e0f38aa0c70500_.log
2024-12-18T00:22:12.0974798Z Running 0 items in this shard:
2024-12-18T00:22:12.0975279Z 
2024-12-18T00:22:12.0976981Z Running lazy/test_bindings 1/1 ... [2024-12-18 00:22:12.097329]
2024-12-18T00:22:12.0977983Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:22:12.0985544Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'lazy/test_bindings.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:22:12.098060]
2024-12-18T00:22:14.3608644Z 
2024-12-18T00:22:14.3609872Z lazy/test_bindings 1/1 was successful, full logs can be found in artifacts with path test/test-reports/lazy.test_bindings_1.1_4ec41967e7f9b581_.log
2024-12-18T00:22:14.3610643Z 
2024-12-18T00:22:14.3614668Z Running test_expanded_weights 1/1 ... [2024-12-18 00:22:14.361154]
2024-12-18T00:22:14.3615233Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:22:14.3620737Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_expanded_weights.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:22:14.361699]
2024-12-18T00:22:21.0897638Z 
2024-12-18T00:22:21.0898875Z test_expanded_weights 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_expanded_weights_1.1_04f60c98b358339b_.log
2024-12-18T00:22:21.0899869Z Running 0 items in this shard:
2024-12-18T00:22:21.0900150Z 
2024-12-18T00:22:21.0903667Z Running test_compile_benchmark_util 1/1 ... [2024-12-18 00:22:21.090032]
2024-12-18T00:22:21.0904249Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:22:21.0909477Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_compile_benchmark_util.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:22:21.090554]
2024-12-18T00:22:26.0149978Z 
2024-12-18T00:22:26.0151272Z test_compile_benchmark_util 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_compile_benchmark_util_1.1_d2f3dacfc2bb6f01_.log
2024-12-18T00:22:26.0152293Z Running 0 items in this shard:
2024-12-18T00:22:26.0152552Z 
2024-12-18T00:22:26.0156493Z Running torch_np/numpy_tests/core/test_scalarinherit 1/1 ... [2024-12-18 00:22:26.015281]
2024-12-18T00:22:26.0157218Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:22:26.0162623Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'torch_np/numpy_tests/core/test_scalarinherit.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:22:26.015840]
2024-12-18T00:22:30.9401783Z 
2024-12-18T00:22:30.9403323Z torch_np/numpy_tests/core/test_scalarinherit 1/1 was successful, full logs can be found in artifacts with path test/test-reports/torch_np.numpy_tests.core.test_scalarinherit_1.1_6bb2c542ade3ab6b_.log
2024-12-18T00:22:30.9404521Z Running 0 items in this shard:
2024-12-18T00:22:30.9404797Z 
2024-12-18T00:22:30.9407776Z Running test_openmp 1/1 ... [2024-12-18 00:22:30.940461]
2024-12-18T00:22:30.9408289Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:22:30.9413409Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_openmp.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:22:30.940970]
2024-12-18T00:22:35.8647397Z 
2024-12-18T00:22:35.8648742Z test_openmp 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_openmp_1.1_f74cc09569b82184_.log
2024-12-18T00:22:35.8649633Z Running 0 items in this shard:
2024-12-18T00:22:35.8649909Z 
2024-12-18T00:22:35.8653724Z Running profiler/test_profiler 1/1 ... [2024-12-18 00:22:35.865037]
2024-12-18T00:22:35.8654294Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:22:35.8659750Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'profiler/test_profiler.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:22:35.865546]
2024-12-18T00:22:41.5407157Z 
2024-12-18T00:22:41.5408232Z profiler/test_profiler 1/1 was successful, full logs can be found in artifacts with path test/test-reports/profiler.test_profiler_1.1_a85b02a600b8bbda_.log
2024-12-18T00:22:41.5414326Z Running 10 items in this shard: test/profiler/test_profiler.py::TestProfiler::test_source_multithreaded_basic_work_in_main_thread_False, test/profiler/test_profiler.py::TestProfiler::test_source_multithreaded_basic_work_in_main_thread_True, test/profiler/test_profiler.py::TestProfiler::test_source_multithreaded_close_in_scope_work_in_main_thread_False, test/profiler/test_profiler.py::TestProfiler::test_source_multithreaded_close_in_scope_work_in_main_thread_True, test/profiler/test_profiler.py::TestProfiler::test_source_multithreaded_complex_work_in_main_thread_False, test/profiler/test_profiler.py::TestProfiler::test_source_multithreaded_complex_work_in_main_thread_True, test/profiler/test_profiler.py::TestProfiler::test_source_multithreaded_multiple_preexisting_work_in_main_thread_False, test/profiler/test_profiler.py::TestProfiler::test_source_multithreaded_multiple_preexisting_work_in_main_thread_True, test/profiler/test_profiler.py::TestProfiler::test_source_multithreaded_open_in_scope_work_in_main_thread_False, test/profiler/test_profiler.py::TestProfiler::test_source_multithreaded_open_in_scope_work_in_main_thread_True
2024-12-18T00:22:41.5419981Z 
2024-12-18T00:22:41.5420251Z Running torch_np/test_random 1/1 ... [2024-12-18 00:22:41.540994]
2024-12-18T00:22:41.5420785Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:22:41.5422075Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'torch_np/test_random.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:22:41.541476]
2024-12-18T00:22:46.5158017Z 
2024-12-18T00:22:46.5159022Z torch_np/test_random 1/1 was successful, full logs can be found in artifacts with path test/test-reports/torch_np.test_random_1.1_21b75ccc83ccc6d0_.log
2024-12-18T00:22:46.5160005Z Running 0 items in this shard:
2024-12-18T00:22:46.5160264Z 
2024-12-18T00:22:46.5163791Z Running test_functionalization 1/1 ... [2024-12-18 00:22:46.516059]
2024-12-18T00:22:46.5164370Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:22:46.5170336Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_functionalization.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:22:46.516632]
2024-12-18T00:22:51.4906119Z 
2024-12-18T00:22:51.4907213Z test_functionalization 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_functionalization_1.1_35e3108cd05a4404_.log
2024-12-18T00:22:51.4908185Z Running 0 items in this shard:
2024-12-18T00:22:51.4908469Z 
2024-12-18T00:22:51.4912741Z Running test_proxy_tensor 1/1 ... [2024-12-18 00:22:51.490914]
2024-12-18T00:22:51.4913692Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:22:51.4918383Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_proxy_tensor.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:22:51.491460]
2024-12-18T00:22:58.4693993Z 
2024-12-18T00:22:58.4695486Z test_proxy_tensor 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_proxy_tensor_1.1_fb2a724e393146ce_.log
2024-12-18T00:22:58.4696435Z Running 0 items in this shard:
2024-12-18T00:22:58.4696691Z 
2024-12-18T00:22:58.4701017Z Running torch_np/test_basic 1/1 ... [2024-12-18 00:22:58.469772]
2024-12-18T00:22:58.4701563Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:22:58.4706519Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'torch_np/test_basic.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:22:58.470305]
2024-12-18T00:23:03.9457316Z 
2024-12-18T00:23:03.9458490Z torch_np/test_basic 1/1 was successful, full logs can be found in artifacts with path test/test-reports/torch_np.test_basic_1.1_c4765e6f4b8081e7_.log
2024-12-18T00:23:03.9459461Z Running 0 items in this shard:
2024-12-18T00:23:03.9459983Z 
2024-12-18T00:23:03.9463804Z Running test_complex 1/1 ... [2024-12-18 00:23:03.946057]
2024-12-18T00:23:03.9464319Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:23:03.9469852Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_complex.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:23:03.946578]
2024-12-18T00:23:09.2215183Z 
2024-12-18T00:23:09.2216302Z test_complex 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_complex_1.1_ec70f0b8df83c7fe_.log
2024-12-18T00:23:09.2217208Z Running 0 items in this shard:
2024-12-18T00:23:09.2217465Z 
2024-12-18T00:23:09.2221064Z Running test_tensorexpr_pybind 1/1 ... [2024-12-18 00:23:09.221790]
2024-12-18T00:23:09.2221633Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:23:09.2226729Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_tensorexpr_pybind.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:23:09.222306]
2024-12-18T00:23:14.2467714Z 
2024-12-18T00:23:14.2468958Z test_tensorexpr_pybind 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_tensorexpr_pybind_1.1_9e840ed887036c2b_.log
2024-12-18T00:23:14.2469902Z Running 0 items in this shard:
2024-12-18T00:23:14.2470190Z 
2024-12-18T00:23:14.2473286Z Running test_type_hints 1/1 ... [2024-12-18 00:23:14.247030]
2024-12-18T00:23:14.2473852Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:23:14.2478496Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_type_hints.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:23:14.247498]
2024-12-18T00:23:19.2718735Z 
2024-12-18T00:23:19.2719846Z test_type_hints 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_type_hints_1.1_79f5ebb65c74b67c_.log
2024-12-18T00:23:19.2720731Z Running 0 items in this shard:
2024-12-18T00:23:19.2720988Z 
2024-12-18T00:23:19.2724244Z Running functorch/test_minifier 1/1 ... [2024-12-18 00:23:19.272107]
2024-12-18T00:23:19.2724816Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:23:19.2729423Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'functorch/test_minifier.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:23:19.272558]
2024-12-18T00:23:24.2469552Z 
2024-12-18T00:23:24.2470788Z functorch/test_minifier 1/1 was successful, full logs can be found in artifacts with path test/test-reports/functorch.test_minifier_1.1_529ba6a7b72f6cb7_.log
2024-12-18T00:23:24.2472094Z Running 0 items in this shard:
2024-12-18T00:23:24.2472412Z 
2024-12-18T00:23:24.2475477Z Running test_jiterator 1/1 ... [2024-12-18 00:23:24.247171]
2024-12-18T00:23:24.2476038Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:23:24.2479767Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_jiterator.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:23:24.247631]
2024-12-18T00:23:29.8730257Z 
2024-12-18T00:23:29.8731430Z test_jiterator 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_jiterator_1.1_0e0c4f62558b2388_.log
2024-12-18T00:23:29.8732365Z Running 0 items in this shard:
2024-12-18T00:23:29.8732627Z 
2024-12-18T00:23:29.8736355Z Running torch_np/numpy_tests/core/test_numeric 1/1 ... [2024-12-18 00:23:29.873311]
2024-12-18T00:23:29.8736992Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:23:29.8742345Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'torch_np/numpy_tests/core/test_numeric.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:23:29.873850]
2024-12-18T00:23:35.0487251Z 
2024-12-18T00:23:35.0488669Z torch_np/numpy_tests/core/test_numeric 1/1 was successful, full logs can be found in artifacts with path test/test-reports/torch_np.numpy_tests.core.test_numeric_1.1_bb2c00386a1e088f_.log
2024-12-18T00:23:35.0489769Z Running 0 items in this shard:
2024-12-18T00:23:35.0490047Z 
2024-12-18T00:23:35.0492913Z Running test_per_overload_api 1/1 ... [2024-12-18 00:23:35.048975]
2024-12-18T00:23:35.0493478Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:23:35.0498068Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_per_overload_api.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:23:35.049461]
2024-12-18T00:23:40.0235100Z 
2024-12-18T00:23:40.0236150Z test_per_overload_api 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_per_overload_api_1.1_4a8e5aa3dd62b8c1_.log
2024-12-18T00:23:40.0237093Z Running 0 items in this shard:
2024-12-18T00:23:40.0237368Z 
2024-12-18T00:23:40.0241250Z Running test_numpy_interop 1/1 ... [2024-12-18 00:23:40.023798]
2024-12-18T00:23:40.0241793Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:23:40.0246855Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_numpy_interop.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:23:40.024310]
2024-12-18T00:23:45.2992432Z 
2024-12-18T00:23:45.2993479Z test_numpy_interop 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_numpy_interop_1.1_9412e67d74e5ff29_.log
2024-12-18T00:23:45.2994400Z Running 0 items in this shard:
2024-12-18T00:23:45.2994656Z 
2024-12-18T00:23:45.2997879Z Running nn/test_multihead_attention 1/1 ... [2024-12-18 00:23:45.299470]
2024-12-18T00:23:45.2998470Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:23:45.3003067Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'nn/test_multihead_attention.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:23:45.299925]
2024-12-18T00:23:50.6246226Z 
2024-12-18T00:23:50.6247355Z nn/test_multihead_attention 1/1 was successful, full logs can be found in artifacts with path test/test-reports/nn.test_multihead_attention_1.1_aeee47db7d7af929_.log
2024-12-18T00:23:50.6248351Z Running 0 items in this shard:
2024-12-18T00:23:50.6249033Z 
2024-12-18T00:23:50.6252726Z Running test_fx_experimental 1/1 ... [2024-12-18 00:23:50.624899]
2024-12-18T00:23:50.6253349Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:23:50.6270574Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_fx_experimental.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:23:50.625378]
2024-12-18T00:23:57.6533391Z 
2024-12-18T00:23:57.6534484Z test_fx_experimental 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_fx_experimental_1.1_992e483190b610c2_.log
2024-12-18T00:23:57.6535453Z Running 0 items in this shard:
2024-12-18T00:23:57.6535733Z 
2024-12-18T00:23:57.6539378Z Running functorch/test_logging 1/1 ... [2024-12-18 00:23:57.653628]
2024-12-18T00:23:57.6539962Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:23:57.6545430Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'functorch/test_logging.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:23:57.654144]
2024-12-18T00:24:02.6285778Z 
2024-12-18T00:24:02.6286864Z functorch/test_logging 1/1 was successful, full logs can be found in artifacts with path test/test-reports/functorch.test_logging_1.1_a7d0910b6154f487_.log
2024-12-18T00:24:02.6287830Z Running 0 items in this shard:
2024-12-18T00:24:02.6288086Z 
2024-12-18T00:24:02.6291092Z Running test_native_functions 1/1 ... [2024-12-18 00:24:02.628806]
2024-12-18T00:24:02.6291646Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:24:02.6296228Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_native_functions.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:24:02.629278]
2024-12-18T00:24:07.6034255Z 
2024-12-18T00:24:07.6035582Z test_native_functions 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_native_functions_1.1_4e59147fdec495b6_.log
2024-12-18T00:24:07.6036521Z Running 0 items in this shard:
2024-12-18T00:24:07.6036801Z 
2024-12-18T00:24:07.6040541Z Running functorch/test_control_flow 1/1 ... [2024-12-18 00:24:07.603741]
2024-12-18T00:24:07.6041141Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:24:07.6047062Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'functorch/test_control_flow.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:24:07.604324]
2024-12-18T00:24:13.4802242Z 
2024-12-18T00:24:13.4803492Z functorch/test_control_flow 1/1 was successful, full logs can be found in artifacts with path test/test-reports/functorch.test_control_flow_1.1_ce36eeadbf283890_.log
2024-12-18T00:24:13.4804515Z Running 0 items in this shard:
2024-12-18T00:24:13.4804805Z 
2024-12-18T00:24:13.4808674Z Running torch_np/test_ufuncs_basic 1/1 ... [2024-12-18 00:24:13.480535]
2024-12-18T00:24:13.4809266Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:24:13.4814777Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'torch_np/test_ufuncs_basic.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:24:13.481062]
2024-12-18T00:24:18.5054839Z 
2024-12-18T00:24:18.5056480Z torch_np/test_ufuncs_basic 1/1 was successful, full logs can be found in artifacts with path test/test-reports/torch_np.test_ufuncs_basic_1.1_eccfdc711691a18b_.log
2024-12-18T00:24:18.5057894Z Running 0 items in this shard:
2024-12-18T00:24:18.5058151Z 
2024-12-18T00:24:18.5061593Z Running nn/test_packed_sequence 1/1 ... [2024-12-18 00:24:18.505823]
2024-12-18T00:24:18.5062145Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:24:18.5067378Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'nn/test_packed_sequence.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:24:18.506357]
2024-12-18T00:24:23.5308529Z 
2024-12-18T00:24:23.5309654Z nn/test_packed_sequence 1/1 was successful, full logs can be found in artifacts with path test/test-reports/nn.test_packed_sequence_1.1_9e1c8758e81ea595_.log
2024-12-18T00:24:23.5310646Z Running 0 items in this shard:
2024-12-18T00:24:23.5310921Z 
2024-12-18T00:24:23.5315711Z Running test_sympy_utils 1/1 ... [2024-12-18 00:24:23.531191]
2024-12-18T00:24:23.5316792Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:24:23.5323628Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_sympy_utils.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:24:23.531868]
2024-12-18T00:24:28.6565656Z 
2024-12-18T00:24:28.6566939Z test_sympy_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_sympy_utils_1.1_d3217466dd968a99_.log
2024-12-18T00:24:28.6567824Z Running 0 items in this shard:
2024-12-18T00:24:28.6568103Z 
2024-12-18T00:24:28.6571760Z Running test_set_default_mobile_cpu_allocator 1/1 ... [2024-12-18 00:24:28.656884]
2024-12-18T00:24:28.6572436Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:24:28.6577662Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_set_default_mobile_cpu_allocator.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:24:28.657425]
2024-12-18T00:24:33.6313449Z 
2024-12-18T00:24:33.6314722Z test_set_default_mobile_cpu_allocator 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_set_default_mobile_cpu_allocator_1.1_3f5557bf0bdfbcf0_.log
2024-12-18T00:24:33.6315830Z Running 0 items in this shard:
2024-12-18T00:24:33.6316078Z 
2024-12-18T00:24:33.6319100Z Running test_sparse_semi_structured 1/1 ... [2024-12-18 00:24:33.631616]
2024-12-18T00:24:33.6319677Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:24:33.6324329Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_sparse_semi_structured.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:24:33.632101]
2024-12-18T00:24:39.0069728Z 
2024-12-18T00:24:39.0070855Z test_sparse_semi_structured 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_sparse_semi_structured_1.1_72be59e548575cf0_.log
2024-12-18T00:24:39.0071834Z Running 0 items in this shard:
2024-12-18T00:24:39.0072111Z 
2024-12-18T00:24:39.0075343Z Running nn/test_parametrization 1/1 ... [2024-12-18 00:24:39.007245]
2024-12-18T00:24:39.0075933Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:24:39.0080518Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'nn/test_parametrization.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:24:39.007715]
2024-12-18T00:24:44.3827100Z 
2024-12-18T00:24:44.3828192Z nn/test_parametrization 1/1 was successful, full logs can be found in artifacts with path test/test-reports/nn.test_parametrization_1.1_b959132a85ff94dc_.log
2024-12-18T00:24:44.3829545Z Running 0 items in this shard:
2024-12-18T00:24:44.3829805Z 
2024-12-18T00:24:44.3832484Z Running functorch/test_vmap 1/1 ... [2024-12-18 00:24:44.382944]
2024-12-18T00:24:44.3833017Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:24:44.3838158Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'functorch/test_vmap.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:24:44.383429]
2024-12-18T00:24:51.7119423Z 
2024-12-18T00:24:51.7120427Z functorch/test_vmap 1/1 was successful, full logs can be found in artifacts with path test/test-reports/functorch.test_vmap_1.1_d9636d89e61e05c3_.log
2024-12-18T00:24:51.7121385Z Running 0 items in this shard:
2024-12-18T00:24:51.7121646Z 
2024-12-18T00:24:51.7125163Z Running test_decomp 6/25 ... [2024-12-18 00:24:51.712227]
2024-12-18T00:24:51.7125860Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:24:51.7130773Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_decomp.py', '-m', 'serial', '--shard-id=6', '--num-shards=25', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:24:51.712714]
2024-12-18T00:25:00.7943484Z 
2024-12-18T00:25:00.7944523Z test_decomp 6/25 was successful, full logs can be found in artifacts with path test/test-reports/test_decomp_6.25_1ebaafdcfacd8127_.log
2024-12-18T00:25:00.7945397Z Running 0 items in this shard:
2024-12-18T00:25:00.7945655Z 
2024-12-18T00:25:00.7948945Z Running test_decomp 10/25 ... [2024-12-18 00:25:00.794598]
2024-12-18T00:25:00.7949463Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:25:00.7953912Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_decomp.py', '-m', 'serial', '--shard-id=10', '--num-shards=25', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:25:00.795044]
2024-12-18T00:25:09.8766636Z 
2024-12-18T00:25:09.8767798Z test_decomp 10/25 was successful, full logs can be found in artifacts with path test/test-reports/test_decomp_10.25_fb9d2d25903ef2b5_.log
2024-12-18T00:25:09.8768675Z Running 0 items in this shard:
2024-12-18T00:25:09.8768951Z 
2024-12-18T00:25:09.8771798Z Running test_decomp 16/25 ... [2024-12-18 00:25:09.876876]
2024-12-18T00:25:09.8772318Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:25:09.8776888Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_decomp.py', '-m', 'serial', '--shard-id=16', '--num-shards=25', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:25:09.877334]
2024-12-18T00:25:18.9085898Z 
2024-12-18T00:25:18.9087057Z test_decomp 16/25 was successful, full logs can be found in artifacts with path test/test-reports/test_decomp_16.25_824c7a71ec90e0c7_.log
2024-12-18T00:25:18.9087931Z Running 0 items in this shard:
2024-12-18T00:25:18.9088206Z 
2024-12-18T00:25:18.9091417Z Running test_decomp 20/25 ... [2024-12-18 00:25:18.908829]
2024-12-18T00:25:18.9091934Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:25:18.9096630Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_decomp.py', '-m', 'serial', '--shard-id=20', '--num-shards=25', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:25:18.909293]
2024-12-18T00:25:27.9910050Z 
2024-12-18T00:25:27.9910973Z test_decomp 20/25 was successful, full logs can be found in artifacts with path test/test-reports/test_decomp_20.25_b5d503e505780d18_.log
2024-12-18T00:25:27.9911836Z Running 0 items in this shard:
2024-12-18T00:25:27.9915127Z 
2024-12-18T00:25:27.9915461Z Running test_flop_counter 1/1 ... [2024-12-18 00:25:27.991233]
2024-12-18T00:25:27.9915996Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:25:27.9920264Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_flop_counter.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:25:27.991676]
2024-12-18T00:25:33.5667818Z 
2024-12-18T00:25:33.5669206Z test_flop_counter 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_flop_counter_1.1_b9886bb64d487906_.log
2024-12-18T00:25:33.5670147Z Running 0 items in this shard:
2024-12-18T00:25:33.5670424Z 
2024-12-18T00:25:33.5673228Z Running test_bundled_inputs 1/1 ... [2024-12-18 00:25:33.567034]
2024-12-18T00:25:33.5673772Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:25:33.5678327Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_bundled_inputs.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:25:33.567493]
2024-12-18T00:25:38.5419904Z 
2024-12-18T00:25:38.5420994Z test_bundled_inputs 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_bundled_inputs_1.1_7217424a2b3931d7_.log
2024-12-18T00:25:38.5421936Z Running 0 items in this shard:
2024-12-18T00:25:38.5422217Z 
2024-12-18T00:25:38.5425717Z Running test_numba_integration 1/1 ... [2024-12-18 00:25:38.542264]
2024-12-18T00:25:38.5426299Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:25:38.5431052Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_numba_integration.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:25:38.542729]
2024-12-18T00:25:43.7675266Z 
2024-12-18T00:25:43.7676531Z test_numba_integration 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_numba_integration_1.1_34369798f708ebd5_.log
2024-12-18T00:25:43.7677606Z Running 0 items in this shard:
2024-12-18T00:25:43.7677872Z 
2024-12-18T00:25:43.7680717Z Running test_itt 1/1 ... [2024-12-18 00:25:43.767769]
2024-12-18T00:25:43.7681259Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:25:43.7686052Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_itt.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:25:43.768257]
2024-12-18T00:25:48.6923559Z 
2024-12-18T00:25:48.6929886Z test_itt 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_itt_1.1_8625eb74db9b4d12_.log
2024-12-18T00:25:48.6930718Z Running 0 items in this shard:
2024-12-18T00:25:48.6930978Z 
2024-12-18T00:25:48.6931287Z Running profiler/test_profiler_tree 1/1 ... [2024-12-18 00:25:48.692626]
2024-12-18T00:25:48.6932127Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:25:48.6934419Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'profiler/test_profiler_tree.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:25:48.693105]
2024-12-18T00:25:53.6673543Z 
2024-12-18T00:25:53.6674788Z profiler/test_profiler_tree 1/1 was successful, full logs can be found in artifacts with path test/test-reports/profiler.test_profiler_tree_1.1_9717f2de349cbfb2_.log
2024-12-18T00:25:53.6675820Z Running 0 items in this shard:
2024-12-18T00:25:53.6676092Z 
2024-12-18T00:25:53.6679641Z Running torch_np/numpy_tests/core/test_shape_base 1/1 ... [2024-12-18 00:25:53.667631]
2024-12-18T00:25:53.6680312Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:25:53.6686039Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'torch_np/numpy_tests/core/test_shape_base.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:25:53.668200]
2024-12-18T00:25:58.6425407Z 
2024-12-18T00:25:58.6426713Z torch_np/numpy_tests/core/test_shape_base 1/1 was successful, full logs can be found in artifacts with path test/test-reports/torch_np.numpy_tests.core.test_shape_base_1.1_cecd0720aac2fab8_.log
2024-12-18T00:25:58.6428236Z Running 0 items in this shard:
2024-12-18T00:25:58.6428548Z 
2024-12-18T00:25:58.6432009Z Running torch_np/numpy_tests/core/test_scalarmath 1/1 ... [2024-12-18 00:25:58.642830]
2024-12-18T00:25:58.6432662Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:25:58.6437475Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'torch_np/numpy_tests/core/test_scalarmath.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:25:58.643356]
2024-12-18T00:26:03.6679174Z 
2024-12-18T00:26:03.6680685Z torch_np/numpy_tests/core/test_scalarmath 1/1 was successful, full logs can be found in artifacts with path test/test-reports/torch_np.numpy_tests.core.test_scalarmath_1.1_b650df27864ed0be_.log
2024-12-18T00:26:03.6681910Z Running 0 items in this shard:
2024-12-18T00:26:03.6682170Z 
2024-12-18T00:26:03.6685255Z Running test_fx_reinplace_pass 1/1 ... [2024-12-18 00:26:03.668206]
2024-12-18T00:26:03.6685817Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:26:03.6691252Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_fx_reinplace_pass.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:26:03.668728]
2024-12-18T00:26:08.5927233Z 
2024-12-18T00:26:08.5928269Z test_fx_reinplace_pass 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_fx_reinplace_pass_1.1_d14299b40f6c202b_.log
2024-12-18T00:26:08.5929227Z Running 0 items in this shard:
2024-12-18T00:26:08.5929533Z 
2024-12-18T00:26:08.5933008Z Running functorch/test_dims 1/1 ... [2024-12-18 00:26:08.592966]
2024-12-18T00:26:08.5933749Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:26:08.5938564Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'functorch/test_dims.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:26:08.593508]
2024-12-18T00:26:13.8181789Z 
2024-12-18T00:26:13.8183033Z functorch/test_dims 1/1 was successful, full logs can be found in artifacts with path test/test-reports/functorch.test_dims_1.1_d453a4526ae94521_.log
2024-12-18T00:26:13.8183982Z Running 0 items in this shard:
2024-12-18T00:26:13.8184258Z 
2024-12-18T00:26:13.8190229Z Running test_fx_passes 1/1 ... [2024-12-18 00:26:13.818713]
2024-12-18T00:26:13.8190754Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:26:13.8196785Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_fx_passes.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:26:13.819330]
2024-12-18T00:26:18.8435846Z 
2024-12-18T00:26:18.8436878Z test_fx_passes 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_fx_passes_1.1_f24f3dac5e545cd5_.log
2024-12-18T00:26:18.8437757Z Running 0 items in this shard:
2024-12-18T00:26:18.8438012Z 
2024-12-18T00:26:18.8441692Z Running test_segment_reductions 1/1 ... [2024-12-18 00:26:18.843872]
2024-12-18T00:26:18.8442265Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:26:18.8446696Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_segment_reductions.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:26:18.844339]
2024-12-18T00:26:24.1187532Z 
2024-12-18T00:26:24.1188816Z test_segment_reductions 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_segment_reductions_1.1_a22ef304d6256ac6_.log
2024-12-18T00:26:24.1189789Z Running 0 items in this shard:
2024-12-18T00:26:24.1190049Z 
2024-12-18T00:26:24.1194220Z Running torch_np/numpy_tests/core/test_multiarray 1/1 ... [2024-12-18 00:26:24.119068]
2024-12-18T00:26:24.1194895Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:26:24.1199390Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'torch_np/numpy_tests/core/test_multiarray.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:26:24.119571]
2024-12-18T00:26:29.3944293Z 
2024-12-18T00:26:29.3945787Z torch_np/numpy_tests/core/test_multiarray 1/1 was successful, full logs can be found in artifacts with path test/test-reports/torch_np.numpy_tests.core.test_multiarray_1.1_683e820b8d340505_.log
2024-12-18T00:26:29.3946969Z Running 0 items in this shard:
2024-12-18T00:26:29.3947235Z 
2024-12-18T00:26:29.3949731Z Running test_legacy_vmap 1/1 ... [2024-12-18 00:26:29.394679]
2024-12-18T00:26:29.3950270Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:26:29.3955240Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_legacy_vmap.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:26:29.395182]
2024-12-18T00:26:34.7198488Z 
2024-12-18T00:26:34.7199488Z test_legacy_vmap 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_legacy_vmap_1.1_d392a7e6337f47b3_.log
2024-12-18T00:26:34.7200381Z Running 0 items in this shard:
2024-12-18T00:26:34.7200655Z 
2024-12-18T00:26:34.7204160Z Running test_subclass 1/1 ... [2024-12-18 00:26:34.720133]
2024-12-18T00:26:34.7204789Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:26:34.7209842Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_subclass.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:26:34.720626]
2024-12-18T00:26:39.6946859Z 
2024-12-18T00:26:39.6948110Z test_subclass 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_subclass_1.1_c8dddc02e708c97d_.log
2024-12-18T00:26:39.6948995Z Running 0 items in this shard:
2024-12-18T00:26:39.6949277Z 
2024-12-18T00:26:39.6952589Z Running torch_np/numpy_tests/linalg/test_linalg 1/1 ... [2024-12-18 00:26:39.694952]
2024-12-18T00:26:39.6953231Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:26:39.6958459Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'torch_np/numpy_tests/linalg/test_linalg.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:26:39.695433]
2024-12-18T00:26:44.8699868Z 
2024-12-18T00:26:44.8701169Z torch_np/numpy_tests/linalg/test_linalg 1/1 was successful, full logs can be found in artifacts with path test/test-reports/torch_np.numpy_tests.linalg.test_linalg_1.1_e58e9220f8d44654_.log
2024-12-18T00:26:44.8702314Z Running 0 items in this shard:
2024-12-18T00:26:44.8702596Z 
2024-12-18T00:26:44.8705636Z Running test_dlpack 1/1 ... [2024-12-18 00:26:44.870202]
2024-12-18T00:26:44.8706144Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:26:44.8711015Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_dlpack.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:26:44.870712]
2024-12-18T00:26:50.1957835Z 
2024-12-18T00:26:50.1959060Z test_dlpack 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_dlpack_1.1_a916bc40844cbb0d_.log
2024-12-18T00:26:50.1960315Z Running 0 items in this shard:
2024-12-18T00:26:50.1960598Z 
2024-12-18T00:26:50.1964322Z Running nn/test_embedding 1/1 ... [2024-12-18 00:26:50.196085]
2024-12-18T00:26:50.1965057Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:26:50.1969862Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'nn/test_embedding.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:26:50.196595]
2024-12-18T00:26:55.6716938Z 
2024-12-18T00:26:55.6718146Z nn/test_embedding 1/1 was successful, full logs can be found in artifacts with path test/test-reports/nn.test_embedding_1.1_52b141fa94f1478d_.log
2024-12-18T00:26:55.6719070Z Running 0 items in this shard:
2024-12-18T00:26:55.6719347Z 
2024-12-18T00:26:55.6722430Z Running torch_np/numpy_tests/lib/test_type_check 1/1 ... [2024-12-18 00:26:55.671944]
2024-12-18T00:26:55.6723110Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:26:55.6727977Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'torch_np/numpy_tests/lib/test_type_check.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:26:55.672428]
2024-12-18T00:27:00.6467324Z 
2024-12-18T00:27:00.6468754Z torch_np/numpy_tests/lib/test_type_check 1/1 was successful, full logs can be found in artifacts with path test/test-reports/torch_np.numpy_tests.lib.test_type_check_1.1_b40094b08dd110f7_.log
2024-12-18T00:27:00.6469905Z Running 0 items in this shard:
2024-12-18T00:27:00.6470164Z 
2024-12-18T00:27:00.6472926Z Running test_masked 1/1 ... [2024-12-18 00:27:00.646989]
2024-12-18T00:27:00.6473590Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:27:00.6478142Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_masked.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:27:00.647471]
2024-12-18T00:27:07.2247895Z 
2024-12-18T00:27:07.2248985Z test_masked 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_masked_1.1_c7c37a0b32116e63_.log
2024-12-18T00:27:07.2249841Z Running 0 items in this shard:
2024-12-18T00:27:07.2250100Z 
2024-12-18T00:27:07.2253865Z Running test_jit 1/1 ... [2024-12-18 00:27:07.225055]
2024-12-18T00:27:07.2254398Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:27:07.2259724Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_jit.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:27:07.225537]
2024-12-18T00:27:15.1046925Z 
2024-12-18T00:27:15.1048111Z test_jit 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_jit_1.1_9783859dc4a89359_.log
2024-12-18T00:27:15.1048918Z Running 0 items in this shard:
2024-12-18T00:27:15.1049198Z 
2024-12-18T00:27:15.1052609Z Running torch_np/numpy_tests/core/test_indexing 1/1 ... [2024-12-18 00:27:15.104937]
2024-12-18T00:27:15.1053278Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:27:15.1058359Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'torch_np/numpy_tests/core/test_indexing.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:27:15.105419]
2024-12-18T00:27:20.1808161Z 
2024-12-18T00:27:20.1809787Z torch_np/numpy_tests/core/test_indexing 1/1 was successful, full logs can be found in artifacts with path test/test-reports/torch_np.numpy_tests.core.test_indexing_1.1_ae221fccae1f1852_.log
2024-12-18T00:27:20.1811347Z Running 0 items in this shard:
2024-12-18T00:27:20.1811618Z 
2024-12-18T00:27:20.1813836Z Running functorch/test_vmap_registrations 1/1 ... [2024-12-18 00:27:20.181053]
2024-12-18T00:27:20.1814549Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:27:20.1819206Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'functorch/test_vmap_registrations.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:27:20.181542]
2024-12-18T00:27:25.7586892Z 
2024-12-18T00:27:25.7589230Z functorch/test_vmap_registrations 1/1 was successful, full logs can be found in artifacts with path test/test-reports/functorch.test_vmap_registrations_1.1_8f8c05f384e47a9f_.log
2024-12-18T00:27:25.7591380Z Running 0 items in this shard:
2024-12-18T00:27:25.7591850Z 
2024-12-18T00:27:25.7594909Z Running profiler/test_memory_profiler 1/1 ... [2024-12-18 00:27:25.759120]
2024-12-18T00:27:25.7596097Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:27:25.7602859Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'profiler/test_memory_profiler.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:27:25.759806]
2024-12-18T00:27:31.2860183Z 
2024-12-18T00:27:31.2861354Z profiler/test_memory_profiler 1/1 was successful, full logs can be found in artifacts with path test/test-reports/profiler.test_memory_profiler_1.1_432ba14f905db0e3_.log
2024-12-18T00:27:31.2862415Z Running 0 items in this shard:
2024-12-18T00:27:31.2862671Z 
2024-12-18T00:27:31.2866072Z Running test_maskedtensor 1/1 ... [2024-12-18 00:27:31.286318]
2024-12-18T00:27:31.2866609Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:27:31.2872016Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_maskedtensor.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:27:31.286825]
2024-12-18T00:27:38.5172066Z 
2024-12-18T00:27:38.5173079Z test_maskedtensor 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_maskedtensor_1.1_9b7e16424efdab00_.log
2024-12-18T00:27:38.5174017Z Running 0 items in this shard:
2024-12-18T00:27:38.5174272Z 
2024-12-18T00:27:38.5177860Z Running nn/test_dropout 1/1 ... [2024-12-18 00:27:38.517479]
2024-12-18T00:27:38.5178377Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:27:38.5183448Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'nn/test_dropout.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:27:38.517987]
2024-12-18T00:27:44.0947547Z 
2024-12-18T00:27:44.0948562Z nn/test_dropout 1/1 was successful, full logs can be found in artifacts with path test/test-reports/nn.test_dropout_1.1_33bcdf255cbec91d_.log
2024-12-18T00:27:44.0949478Z Running 0 items in this shard:
2024-12-18T00:27:44.0949755Z 
2024-12-18T00:27:44.0953143Z Running test_meta 1/4 ... [2024-12-18 00:27:44.095019]
2024-12-18T00:27:44.0953631Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:27:44.0959159Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_meta.py', '-m', 'serial', '--shard-id=1', '--num-shards=4', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:27:44.095529]
2024-12-18T00:28:01.5966116Z 
2024-12-18T00:28:01.5967209Z test_meta 1/4 was successful, full logs can be found in artifacts with path test/test-reports/test_meta_1.4_a76203b740b9b4dd_.log
2024-12-18T00:28:01.5968038Z Running 0 items in this shard:
2024-12-18T00:28:01.5968316Z 
2024-12-18T00:28:01.5972112Z Running test_quantization 1/3 ... [2024-12-18 00:28:01.596904]
2024-12-18T00:28:01.5973070Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:28:01.5977758Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_quantization.py', '-m', 'serial', '--shard-id=1', '--num-shards=3', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:28:01.597415]
2024-12-18T00:28:08.0746709Z 
2024-12-18T00:28:08.0747749Z test_quantization 1/3 was successful, full logs can be found in artifacts with path test/test-reports/test_quantization_1.3_62bce2eb8a5ca344_.log
2024-12-18T00:28:08.0748663Z Running 0 items in this shard:
2024-12-18T00:28:08.0748920Z 
2024-12-18T00:28:08.0752682Z Running test_quantization 2/3 ... [2024-12-18 00:28:08.074967]
2024-12-18T00:28:08.0753231Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:28:08.0759206Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_quantization.py', '-m', 'serial', '--shard-id=2', '--num-shards=3', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:28:08.075502]
2024-12-18T00:28:14.2019724Z 
2024-12-18T00:28:14.2020781Z test_quantization 2/3 was successful, full logs can be found in artifacts with path test/test-reports/test_quantization_2.3_5f58748cc8afc1f0_.log
2024-12-18T00:28:14.2021703Z Running 0 items in this shard:
2024-12-18T00:28:14.2022006Z 
2024-12-18T00:28:14.2026140Z Running optim/test_lrscheduler 1/1 ... [2024-12-18 00:28:14.202250]
2024-12-18T00:28:14.2026708Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:28:14.2031512Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'optim/test_lrscheduler.py', '-m', 'serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:28:14.202758]
2024-12-18T00:28:19.0574258Z 
2024-12-18T00:28:19.0575336Z optim/test_lrscheduler 1/1 was successful, full logs can be found in artifacts with path test/test-reports/optim.test_lrscheduler_1.1_db615d9d32802dd8_.log
2024-12-18T00:28:19.0576215Z 
2024-12-18T00:28:19.0688824Z Running test_nestedtensor 1/1 ... [2024-12-18 00:28:19.068473]
2024-12-18T00:28:19.0689824Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:28:19.0697518Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'test_nestedtensor.py', '-m', 'not serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:28:19.069216]
2024-12-18T00:28:19.0791570Z Running dynamo/test_after_aot 1/1 ... [2024-12-18 00:28:19.078817]
2024-12-18T00:28:19.0792138Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:28:19.0797781Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'dynamo/test_after_aot.py', '-m', 'not serial', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:28:19.079409]
2024-12-18T00:28:34.2248202Z 
2024-12-18T00:28:34.2249385Z dynamo/test_after_aot 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_after_aot_1.1_415afac3d11a3baa_.log
2024-12-18T00:28:34.2250934Z Running 2 items in this shard: test/dynamo/test_after_aot.py::TestAfterAot::test_dump_tensor, test/dynamo/test_after_aot.py::TestAfterAot::test_save_graph_repro
2024-12-18T00:28:34.2251748Z 
2024-12-18T00:28:34.9216647Z Uploading artifacts took 0.70 seconds
2024-12-18T00:28:39.6057048Z Running inductor/test_cpu_repro 1/6 ... [2024-12-18 00:28:39.605090]
2024-12-18T00:28:39.6057670Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:28:39.6061328Z Executing ['/opt/conda/envs/py_3.10/bin/python', '-bb', 'inductor/test_cpu_repro.py', '-m', 'not serial', '--shard-id=1', '--num-shards=6', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:28:39.605685]
2024-12-18T00:28:53.8803381Z 
2024-12-18T00:28:53.8804583Z PRINTING LOG FILE of test_nestedtensor 1/1 (test/test-reports/test_nestedtensor_1.1_e97c0bc164da9cc7_.log)
2024-12-18T00:28:53.8805925Z Test results will be stored in test-reports/python-pytest/test_nestedtensor/test_nestedtensor-a57b624bf94dd066.xml
2024-12-18T00:28:53.8807873Z ============================= test session starts ==============================
2024-12-18T00:28:53.8809069Z platform linux -- Python 3.10.15, pytest-7.3.2, pluggy-1.5.0 -- /opt/conda/envs/py_3.10/bin/python
2024-12-18T00:28:53.8809814Z cachedir: .pytest_cache
2024-12-18T00:28:53.8811077Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow]
2024-12-18T00:28:53.8812265Z rootdir: /var/lib/jenkins/workspace
2024-12-18T00:28:53.8812795Z configfile: pytest.ini
2024-12-18T00:28:53.8813985Z plugins: hypothesis-5.35.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, subtests-0.13.1, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0
2024-12-18T00:28:53.8815625Z collecting ... collected 1569 items
2024-12-18T00:28:53.8816442Z stepcurrent: Cannot find last run test, not skipping
2024-12-18T00:28:53.9695227Z Running 1569 items in this shard: test/test_nestedtensor.py::TestNestedTensor::test_2d_nested_tensor_batch_size_2_max_seq_len_3_vocab_size_10, test/test_nestedtensor.py::TestNestedTensor::test_2d_nested_tensor_batch_size_2_max_seq_len_3_vocab_size_20, test/test_nestedtensor.py::TestNestedTensor::test_2d_nested_tensor_batch_size_2_max_seq_len_5_vocab_size_10, test/test_nestedtensor.py::TestNestedTensor::test_2d_nested_tensor_batch_size_2_max_seq_len_5_vocab_size_20, test/test_nestedtensor.py::TestNestedTensor::test_2d_nested_tensor_batch_size_4_max_seq_len_3_vocab_size_10, test/test_nestedtensor.py::TestNestedTensor::test_2d_nested_tensor_batch_size_4_max_seq_len_3_vocab_size_20, test/test_nestedtensor.py::TestNestedTensor::test_2d_nested_tensor_batch_size_4_max_seq_len_5_vocab_size_10, test/test_nestedtensor.py::TestNestedTensor::test_2d_nested_tensor_batch_size_4_max_seq_len_5_vocab_size_20, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_batch_size_2_max_seq_len_3_vocab_size_10, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_batch_size_2_max_seq_len_3_vocab_size_20, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_batch_size_2_max_seq_len_5_vocab_size_10, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_batch_size_2_max_seq_len_5_vocab_size_20, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_batch_size_4_max_seq_len_3_vocab_size_10, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_batch_size_4_max_seq_len_3_vocab_size_20, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_batch_size_4_max_seq_len_5_vocab_size_10, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_batch_size_4_max_seq_len_5_vocab_size_20, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_float_batch_size_2_max_seq_len_3_vocab_size_10, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_float_batch_size_2_max_seq_len_3_vocab_size_20, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_float_batch_size_2_max_seq_len_5_vocab_size_10, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_float_batch_size_2_max_seq_len_5_vocab_size_20, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_float_batch_size_4_max_seq_len_3_vocab_size_10, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_float_batch_size_4_max_seq_len_3_vocab_size_20, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_float_batch_size_4_max_seq_len_5_vocab_size_10, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_float_batch_size_4_max_seq_len_5_vocab_size_20, test/test_nestedtensor.py::TestNestedTensor::test_cat, test/test_nestedtensor.py::TestNestedTensor::test_copy_, test/test_nestedtensor.py::TestNestedTensor::test_default_nested_tensor, test/test_nestedtensor.py::TestNestedTensor::test_dim, test/test_nestedtensor.py::TestNestedTensor::test_fill_, test/test_nestedtensor.py::TestNestedTensor::test_is_contiguous, test/test_nestedtensor.py::TestNestedTensor::test_like_functions_ones_like, test/test_nestedtensor.py::TestNestedTensor::test_like_functions_randn_like, test/test_nestedtensor.py::TestNestedTensor::test_like_functions_zeros_like, test/test_nestedtensor.py::TestNestedTensor::test_nested_namespace, test/test_nestedtensor.py::TestNestedTensor::test_nested_tensor, test/test_nestedtensor.py::TestNestedTensor::test_nested_tensor_matching_dim, test/test_nestedtensor.py::TestNestedTensor::test_numel, test/test_nestedtensor.py::TestNestedTensor::test_repr_string, test/test_nestedtensor.py::TestNestedTensor::test_size, test/test_nestedtensor.py::TestNestedTensor::test_size_dim, test/test_nestedtensor.py::TestNestedTensor::test_stride, test/test_nestedtensor.py::TestNestedTensor::test_to, test/test_nestedtensor.py::TestNestedTensor::test_to_padded_tensor_on_empty_tensor, test/test_nestedtensor.py::TestNestedTensor::test_unbind_0, test/test_nestedtensor.py::TestNestedTensor::test_unbind_1, test/test_nestedtensor.py::TestNestedTensor::test_unbind_3, test/test_nestedtensor.py::TestNestedTensor::test_unbind_4, test/test_nestedtensor.py::TestNestedTensor::test_unbind_dim, test/test_nestedtensor.py::TestNestedTensor::test_zero_, test/test_nestedtensor.py::TestNestedInt::test_comparisons, test/test_nestedtensor.py::TestNestedInt::test_with_factor, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_binary_ops_with_scalar_eq_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_binary_ops_with_scalar_ge_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_bmm_cpu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_bmm_cpu_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_bmm_cuda_cuda_bfloat16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_bmm_cuda_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_bmm_cuda_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_bmm_cuda_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_bmm_noncontiguous_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_bmm_noncontiguous_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_clone_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_clone_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_contiguous_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_contiguous_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_detach_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_detach_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_detach_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_device_checks_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_dropout_jagged_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_dropout_jagged_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_dropout_noncontiguous_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_dropout_noncontiguous_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_dropout_strided_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_dropout_strided_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_embedding_jagged_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_embedding_strided_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_empty_like_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_empty_like_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_empty_like_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_layer_norm_breaking_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_layer_norm_breaking_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_layer_norm_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_layer_norm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_linear_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_linear_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_linear_noncontiguous_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_linear_noncontiguous_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_masked_fill_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_masked_fill_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_masked_fill_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_matmul_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_matmul_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_matmul_noncontiguous_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_matmul_noncontiguous_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_matmul_nt_with_broadcasted_t_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_matmul_nt_with_broadcasted_t_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_matmul_with_bmm_path_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_matmul_with_bmm_path_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_narrow_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_narrow_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_narrow_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_masked_select_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_add_in_place_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_add_in_place_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_add_transpose_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_add_transpose_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_add_transpose_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_add_transpose_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_chunk_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_chunk_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_chunk_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_dense_elementwise_embedding_dim_128_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_dense_elementwise_embedding_dim_128_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_dense_elementwise_embedding_dim_256_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_dense_elementwise_embedding_dim_256_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_dense_elementwise_embedding_dim_384_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_dense_elementwise_embedding_dim_384_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_dense_elementwise_embedding_dim_8_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_dense_elementwise_embedding_dim_8_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_div_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_div_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_indexing_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_indexing_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_indexing_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_indexing_noncontiguous_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_indexing_noncontiguous_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_indexing_noncontiguous_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_mul_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_mul_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_mul_in_place_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_mul_in_place_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_split_with_sizes_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_split_with_sizes_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_split_with_sizes_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_sub_transpose_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_sub_transpose_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_sub_transpose_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_sub_transpose_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_sum_dim_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_reshape_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_reshape_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_reshape_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_scaled_dot_product_attention_input_dim_3_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_scaled_dot_product_attention_input_dim_4_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_False_weights_only_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_False_weights_only_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_False_weights_only_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_False_weights_only_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_False_weights_only_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_False_weights_only_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_True_weights_only_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_True_weights_only_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_True_weights_only_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_True_weights_only_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_True_weights_only_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_True_weights_only_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_softmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_softmax_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_softmax_noncontiguous_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_softmax_noncontiguous_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_squeeze_unsqueeze_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_squeeze_unsqueeze_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_squeeze_unsqueeze_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim2_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim2_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim3_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim3_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim4_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim4_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim4_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_noncontiguous_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_noncontiguous_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_noncontiguous_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_output_size_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_output_size_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_simple_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_simple_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_zero_numel_errors_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_zero_numel_errors_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_zero_numel_errors_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_then_from_padded_tensor_no_transform0213_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_transpose_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_transpose_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_transpose_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_transpose_inference_mode_interaction_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_transpose_inference_mode_interaction_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_transpose_inference_mode_interaction_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_abs__cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_abs_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_cos_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_gelu__cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_gelu_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_isinf_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_isnan_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_isneginf_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_isposinf_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_logical_not_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_neg_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_relu__cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_relu_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_sgn_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_silu__cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_silu_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_sin_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_sqrt_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_tanh__cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_tanh_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unbind_noncontiguous_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unbind_noncontiguous_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unbind_noncontiguous_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_view_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_view_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_view_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_view_inference_mode_interaction_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_view_inference_mode_interaction_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_view_inference_mode_interaction_cuda_float64, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_abs_backward_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_accumulate_grad_different_strides_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_as_nested_tensor_propagates_gradients_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_backward_add_strided_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_backward_for_add_op_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_backward_for_sub_op_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_backward_sub_strided_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_dropout_backward_jagged_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_dropout_backward_strided_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_gelu_backward_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_indexing_backward_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_5d_size_128_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_5d_size_2_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_5d_size_32_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_5d_size_4_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_edge_case_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_size_1023_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_size_1024_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_size_128_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_size_256_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_size_2_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_size_32_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_size_4_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_size_512_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_size_513_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_masked_fill_backward_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_bmm_backward_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_bmm_gradcheck_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_from_list_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_from_mask_and_to_padded_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_from_padded_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_from_padded_fused_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_generates_leaf_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_linear_backward_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_linear_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_linear_plus_transpose_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_matmul_backward_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_matmul_gradcheck_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_reshape_backward_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_reshape_gradcheck_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_softmax_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_squeeze_backward_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_squeeze_gradcheck_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_to_padded_tensor_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_transpose_backward_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_transpose_gradcheck_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_unsqueeze_backward_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_unsqueeze_gradcheck_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_relu_backward_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_selu_backward_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_set_requires_grad_from_list_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_set_requires_grad_from_mask_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_split_with_sizes_flow_through_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_to_buffer_series_ops_grad_with_broadcast_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_unbind_flow_through_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_values_grad_with_broadcast_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_apply__cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_False_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_False_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_False_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_False_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_False_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_False_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_True_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_True_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_True_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_True_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_True_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_True_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_False_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_False_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_False_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_False_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_False_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_False_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_True_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_True_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_True_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_True_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_True_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_True_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_False_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_False_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_False_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_False_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_False_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_False_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_True_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_True_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_True_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_True_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_True_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_True_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_False_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_False_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_False_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_False_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_False_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_False_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_True_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_True_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_True_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_True_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_True_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_True_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_False_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_False_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_False_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_False_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_False_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_False_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_True_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_True_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_True_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_True_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_True_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_True_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_False_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_False_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_False_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_False_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_False_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_False_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_True_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_True_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_True_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_True_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_True_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_True_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_False_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_False_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_False_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_False_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_False_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_False_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_True_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_True_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_True_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_True_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_True_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_True_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_False_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_False_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_False_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_False_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_False_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_False_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_True_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_True_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_True_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_True_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_True_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_True_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_False_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_False_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_False_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_False_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_False_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_False_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_True_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_True_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_True_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_True_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_True_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_True_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_False_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_False_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_False_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_False_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_False_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_False_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_True_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_True_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_True_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_True_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_True_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_True_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_autograd_function_with_None_grad_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_binary_pointwise_broadcasting_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_binary_pointwise_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_binary_pointwise_transposed_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_binary_pointwise_with_nested_int_second_arg_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_chunk_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_compile_padded_dense_conversion_preserves_metadata_cache_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_compile_preserves_metadata_cache_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_compile_with_dynamic_max_seq_len_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_compile_with_dynamic_min_seq_len_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_compile_with_propagated_dynamic_max_seq_len_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_composite_op_in_inference_mode_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_composite_op_with_custom_mode_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_construction_from_list_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_copy__cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_device_dtype_transfer_updates_offsets_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_device_dtype_transfer_updates_offsets_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_dummy_mha_with_nt_use_legacy_api_False_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_dummy_mha_with_nt_use_legacy_api_True_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_flatten_decomp_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_flex_attention_converts_stacked_seq_indices_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_flex_attention_noncontig_with_holes_False_cross_attention_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_flex_attention_noncontig_with_holes_False_cross_attention_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_flex_attention_noncontig_with_holes_True_cross_attention_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_flex_attention_noncontig_with_holes_True_cross_attention_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_index_put_error_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_is_contiguous_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_is_same_size_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_as_nested_tensor_components_require_grad_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_as_nested_tensor_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_as_nested_tensor_components_require_grad_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_as_nested_tensor_components_require_grad_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_as_nested_tensor_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_as_nested_tensor_components_require_grad_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_False_components_require_grad_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_False_components_require_grad_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_False_components_require_grad_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_False_components_require_grad_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_True_components_require_grad_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_True_components_require_grad_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_True_components_require_grad_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_True_components_require_grad_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_with_pinned_memory_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_mean_keepdim_False_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_mean_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_mean_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_mean_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_mean_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_mean_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_mean_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_mean_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_sum_keepdim_False_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_sum_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_sum_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_sum_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_sum_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_sum_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_sum_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_sum_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_padded_dense_conversion_kernels_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_padded_dense_conversion_kernels_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_padded_dense_conversion_kernels_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_False_values_is_view_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_False_values_is_view_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_False_values_is_view_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_False_values_is_view_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_False_values_is_view_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_False_values_is_view_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_True_values_is_view_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_True_values_is_view_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_True_values_is_view_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_True_values_is_view_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_True_values_is_view_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_True_values_is_view_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_2d_input_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_2d_input_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_2d_input_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_2d_input_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_operate_on_batch_dim_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_operate_on_batch_dim_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_operate_on_batch_dim_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_operate_on_batch_dim_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_reduce_ragged_idx_1_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_reduce_ragged_idx_1_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_reduce_ragged_idx_1_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_reduce_ragged_idx_1_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_with_lengths_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_with_lengths_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_with_lengths_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_with_lengths_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layout_under_torch_dispatch_mode_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_like_shape_empty_like_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_like_shape_randn_like_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_like_value_ones_like_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_like_value_zeros_like_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_backward_memory_usage_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_nt_dim_3_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_nt_dim_4_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_nt_dim_5_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_narrow_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_nested_tensor_activation_checkpoint_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_nested_tensor_from_jagged_fx_trace_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_nested_tensor_from_jagged_pass_min_max_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_nested_tensor_from_jagged_pass_min_max_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_njt_cat_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_noncontiguous_pointwise_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_noncontiguous_to_noncontig_transposed_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_noncontiguous_to_noncontig_transposed_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_noncontiguous_to_noncontig_transposed_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_noncontiguous_to_noncontig_with_holes_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_noncontiguous_to_noncontig_with_holes_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_noncontiguous_to_noncontig_with_holes_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_mean_keepdim_False_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_mean_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_mean_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_mean_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_mean_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_mean_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_mean_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_mean_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_sum_keepdim_False_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_sum_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_sum_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_sum_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_sum_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_sum_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_sum_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_sum_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_mean_keepdim_False_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_mean_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_mean_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_mean_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_mean_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_mean_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_mean_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_mean_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_sum_keepdim_False_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_sum_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_sum_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_sum_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_sum_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_sum_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_sum_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_sum_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_1_keepdim_False_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_1_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_1_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_1_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_1_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_1_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_1_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_1_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_2_keepdim_False_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_2_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_2_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_2_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_2_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_2_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_2_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_2_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_1_keepdim_False_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_1_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_1_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_1_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_1_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_1_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_1_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_1_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_2_keepdim_False_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_2_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_2_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_2_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_2_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_2_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_2_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_2_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_transpose_non_ragged_dim_different_output_shape_mean_keepdim_False_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_transpose_non_ragged_dim_different_output_shape_mean_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_transpose_non_ragged_dim_different_output_shape_mean_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_transpose_non_ragged_dim_different_output_shape_mean_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_transpose_non_ragged_dim_different_output_shape_mean_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_transpose_non_ragged_dim_different_output_shape_mean_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_transpose_non_ragged_dim_different_output_shape_mean_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_transpose_non_ragged_dim_different_output_shape_mean_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_transpose_non_ragged_dim_different_output_shape_sum_keepdim_False_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_transpose_non_ragged_dim_different_output_shape_sum_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_transpose_non_ragged_dim_different_output_shape_sum_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_transpose_non_ragged_dim_different_output_shape_sum_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_transpose_non_ragged_dim_different_output_shape_sum_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_transpose_non_ragged_dim_different_output_shape_sum_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_transpose_non_ragged_dim_different_output_shape_sum_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_transpose_non_ragged_dim_different_output_shape_sum_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_mean_keepdim_False_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_mean_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_mean_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_mean_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_mean_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_mean_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_mean_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_mean_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_sum_keepdim_False_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_sum_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_sum_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_sum_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_sum_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_sum_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_sum_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_sum_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_permute_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_pin_memory_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_profiler_sequence_nr_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_record_stream_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_reshape_decomp_requires_grad_False_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_reshape_decomp_requires_grad_True_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_autocast_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_backwards_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_backwards_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_compile_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_compile_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_flop_counter_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_with_constant_sequence_length_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_with_constant_sequence_length_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_with_constant_sequence_length_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_with_packed_in_proj_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_with_packed_in_proj_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_serialization_contig_weights_only_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_serialization_contig_weights_only_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_serialization_noncontig_transposed_weights_only_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_serialization_noncontig_transposed_weights_only_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_serialization_noncontig_with_holes_weights_only_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_serialization_noncontig_with_holes_weights_only_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_reduce_ragged_idx_1_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_reduce_ragged_idx_1_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_reduce_ragged_idx_1_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_reduce_ragged_idx_1_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_reduce_ragged_idx_greater_than_1_same_output_shape_transpose_offset_1_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_reduce_ragged_idx_greater_than_1_same_output_shape_transpose_offset_1_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_reduce_ragged_idx_greater_than_1_same_output_shape_transpose_offset_1_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_reduce_ragged_idx_greater_than_1_same_output_shape_transpose_offset_1_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_reduce_ragged_idx_greater_than_1_same_output_shape_transpose_offset_2_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_reduce_ragged_idx_greater_than_1_same_output_shape_transpose_offset_2_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_reduce_ragged_idx_greater_than_1_same_output_shape_transpose_offset_2_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_reduce_ragged_idx_greater_than_1_same_output_shape_transpose_offset_2_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_transpose_non_ragged_dim_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_transpose_non_ragged_dim_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_transpose_non_ragged_dim_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_transpose_non_ragged_dim_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_with_lengths_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_with_lengths_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_with_lengths_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_with_lengths_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_reduce_batch_dim_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_reduce_batch_dim_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_reduce_batch_dim_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_reduce_batch_dim_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_specialize_dynamic_shape_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_specialize_dynamic_shape_recompile_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_split_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_split_with_sizes_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_squeeze_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_batch_and_non_batch_keepdim_False_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_batch_and_non_batch_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_batch_and_non_batch_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_batch_and_non_batch_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_batch_and_non_batch_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_batch_and_non_batch_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_batch_and_non_batch_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_batch_and_non_batch_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_ragged_and_non_batch_keepdim_False_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_ragged_and_non_batch_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_ragged_and_non_batch_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_ragged_and_non_batch_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_ragged_and_non_batch_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_ragged_and_non_batch_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_ragged_and_non_batch_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_ragged_and_non_batch_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_tensor_attributes_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_threshold_backward_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_copy_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_dtype_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_2_requires_grad_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_2_requires_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_2_requires_grad_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_2_requires_grad_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_2_requires_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_2_requires_grad_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_3_requires_grad_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_3_requires_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_3_requires_grad_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_3_requires_grad_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_3_requires_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_3_requires_grad_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_4_requires_grad_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_4_requires_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_4_requires_grad_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_4_requires_grad_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_4_requires_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_4_requires_grad_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_2_requires_grad_False_cuda_bool, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_2_requires_grad_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_2_requires_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_2_requires_grad_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_2_requires_grad_True_cuda_bool, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_2_requires_grad_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_2_requires_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_2_requires_grad_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_3_requires_grad_False_cuda_bool, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_3_requires_grad_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_3_requires_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_3_requires_grad_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_3_requires_grad_True_cuda_bool, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_3_requires_grad_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_3_requires_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_3_requires_grad_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_4_requires_grad_False_cuda_bool, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_4_requires_grad_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_4_requires_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_4_requires_grad_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_4_requires_grad_True_cuda_bool, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_4_requires_grad_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_4_requires_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_4_requires_grad_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unary_pointwise_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unary_pointwise_transposed_inputs_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unbind_backward_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unbind_backward_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unbind_backward_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unbind_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unbind_lengths_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unbind_lengths_ragged_idx_0_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unbind_lengths_ragged_idx_1_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unbind_lengths_ragged_idx_2_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unbind_lengths_ragged_idx_3_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unbind_lengths_ragged_idx_equals_2_bad_dim_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unbind_transpose_ragged_idx_2_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unbind_transpose_ragged_idx_3_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unbind_transpose_ragged_idx_last_dim_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unsafe_view_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_view_ragged_idx_not_one_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_views_inherit_ragged_dim_cuda, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward___radd___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward___rdiv___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward___rmod___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward___rmul___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward___rpow___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward___rsub___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_abs_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_acos_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_acosh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_add_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_amax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_amin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_angle_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_asin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_asinh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_atan2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_atan_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_atanh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_bfloat16_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_bmm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_cdouble_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_ceil_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_cfloat_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_chalf_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_chunk_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_clamp_max_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_clamp_min_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_clone_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_complex_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_conj_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_conj_physical_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_copysign_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_cos_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_cosh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_deg2rad_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_digamma_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_div_floor_rounding_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_div_no_rounding_mode_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_div_trunc_rounding_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_double_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_erf_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_erfc_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_erfinv_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_exp2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_exp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_expm1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_fill_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_float_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_float_power_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_floor_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_fmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_fmin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_fmod_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_frac_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_frexp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_half_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_hypot_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_i0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_index_put_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_ldexp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_lgamma_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_linalg_vector_norm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_log10_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_log1p_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_log2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_log_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_logaddexp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_logit_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_masked_amax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_masked_amin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_masked_logsumexp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_masked_mean_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_masked_norm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_masked_prod_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_masked_select_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_masked_std_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_masked_sum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_masked_var_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_matmul_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_max_binary_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_max_reduction_with_dim_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_maximum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_mean_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_min_binary_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_min_reduction_with_dim_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_minimum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_mul_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_mvlgamma_mvlgamma_p_1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_mvlgamma_mvlgamma_p_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_mvlgamma_mvlgamma_p_5_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nan_to_num_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nanmean_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nansum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_narrow_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_neg_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_celu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_elu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_embedding_bag_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_embedding_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_hardshrink_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_hardsigmoid_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_hardtanh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_linear_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_logsigmoid_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_mish_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_prelu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_relu6_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_relu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_rms_norm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_rrelu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_selu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_silu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_softplus_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_softshrink_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_softsign_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_tanhshrink_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_threshold_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_polar_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_polygamma_polygamma_n_0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_polygamma_polygamma_n_1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_polygamma_polygamma_n_2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_polygamma_polygamma_n_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_polygamma_polygamma_n_4_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_positive_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_pow_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_prod_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_rad2deg_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_real_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_reciprocal_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_remainder_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_round_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_round_decimals_0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_round_decimals_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_round_decimals_neg_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_rsqrt_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_rsub_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_select_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_sgn_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_sigmoid_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_sign_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_sin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_sinc_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_sinh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_special_entr_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_special_erfcx_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_special_i0e_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_special_i1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_special_i1e_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_special_log_ndtr_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_special_ndtr_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_special_ndtri_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_special_polygamma_special_polygamma_n_0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_special_xlog1py_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_split_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_split_with_sizes_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_sqrt_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_square_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_squeeze_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_std_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_std_unbiased_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_sub_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_sum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_tan_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_tanh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_to_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_true_divide_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_trunc_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_unflatten_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_unsqueeze_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_var_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_var_unbiased_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_where_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_xlogy_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward___radd___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward___rdiv___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward___rmod___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward___rmul___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward___rpow___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward___rsub___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_abs_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_acos_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_acosh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_add_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_amax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_amin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_angle_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_asin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_asinh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_atan2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_atan_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_atanh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_bfloat16_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_bmm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_cdouble_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_ceil_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_cfloat_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_chalf_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_chunk_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_clamp_max_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_clamp_min_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_clone_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_complex_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_conj_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_conj_physical_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_copysign_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_cos_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_cosh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_deg2rad_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_digamma_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_div_floor_rounding_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_div_no_rounding_mode_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_div_trunc_rounding_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_double_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_erf_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_erfc_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_erfinv_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_exp2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_exp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_expm1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_fill_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_float_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_float_power_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_floor_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_fmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_fmin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_fmod_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_frac_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_frexp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_half_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_hypot_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_i0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_index_put_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_ldexp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_lgamma_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_linalg_vector_norm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_log10_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_log1p_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_log2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_log_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_logaddexp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_logit_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_masked_amax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_masked_amin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_masked_logsumexp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_masked_mean_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_masked_norm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_masked_prod_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_masked_select_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_masked_std_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_masked_sum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_masked_var_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_matmul_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_max_binary_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_max_reduction_with_dim_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_maximum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_mean_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_min_binary_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_min_reduction_with_dim_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_minimum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_mul_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_mvlgamma_mvlgamma_p_1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_mvlgamma_mvlgamma_p_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_mvlgamma_mvlgamma_p_5_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nan_to_num_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nanmean_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nansum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_narrow_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_neg_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_celu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_elu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_embedding_bag_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_embedding_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_hardshrink_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_hardsigmoid_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_hardtanh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_linear_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_logsigmoid_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_mish_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_prelu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_relu6_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_relu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_rms_norm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_rrelu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_selu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_silu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_softplus_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_softshrink_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_softsign_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_tanhshrink_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_threshold_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_polar_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_polygamma_polygamma_n_0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_polygamma_polygamma_n_1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_polygamma_polygamma_n_2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_polygamma_polygamma_n_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_polygamma_polygamma_n_4_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_positive_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_pow_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_prod_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_rad2deg_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_real_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_reciprocal_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_remainder_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_round_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_round_decimals_0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_round_decimals_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_round_decimals_neg_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_rsqrt_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_rsub_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_select_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_sgn_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_sigmoid_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_sign_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_sin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_sinc_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_sinh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_special_entr_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_special_erfcx_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_special_i0e_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_special_i1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_special_i1e_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_special_log_ndtr_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_special_ndtr_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_special_ndtri_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_special_polygamma_special_polygamma_n_0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_special_xlog1py_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_split_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_split_with_sizes_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_sqrt_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_square_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_squeeze_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_std_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_std_unbiased_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_sub_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_sum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_tan_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_tanh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_to_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_true_divide_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_trunc_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_unflatten_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_unsqueeze_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_var_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_var_unbiased_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_where_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_xlogy_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward___radd___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward___rdiv___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward___rmod___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward___rmul___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward___rpow___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward___rsub___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_abs_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_acos_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_acosh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_add_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_all_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_amax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_amin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_angle_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_any_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_argmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_argmin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_asin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_asinh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_atan2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_atan_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_atanh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_bfloat16_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_bmm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_bool_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_byte_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_cdouble_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_ceil_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_cfloat_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_chalf_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_char_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_chunk_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_clamp_max_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_clamp_min_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_clone_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_complex_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_conj_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_conj_physical_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_copysign_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_cos_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_cosh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_count_nonzero_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_deg2rad_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_digamma_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_div_floor_rounding_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_div_no_rounding_mode_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_div_trunc_rounding_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_double_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_eq_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_erf_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_erfc_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_erfinv_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_exp2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_exp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_expm1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_fill_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_float_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_float_power_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_floor_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_floor_divide_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_fmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_fmin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_fmod_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_frac_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_frexp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_ge_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_gt_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_half_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_heaviside_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_hypot_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_i0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_igamma_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_igammac_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_index_put_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_int_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_isclose_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_isfinite_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_isinf_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_isnan_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_isneginf_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_isposinf_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_isreal_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_jiterator_binary_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_jiterator_binary_return_by_ref_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_jiterator_unary_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_ldexp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_le_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_lgamma_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_linalg_vector_norm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_log10_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_log1p_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_log2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_log_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_logaddexp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_logical_and_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_logical_not_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_logical_or_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_logical_xor_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_logit_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_long_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_lt_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_masked_amax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_masked_amin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_masked_argmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_masked_argmin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_masked_logsumexp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_masked_mean_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_masked_norm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_masked_prod_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_masked_select_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_masked_std_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_masked_sum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_masked_var_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_matmul_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_max_binary_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_max_reduction_with_dim_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_maximum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_mean_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_min_binary_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_min_reduction_with_dim_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_minimum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_mul_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_mvlgamma_mvlgamma_p_1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_mvlgamma_mvlgamma_p_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_mvlgamma_mvlgamma_p_5_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nan_to_num_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nanmean_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nansum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_narrow_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_ne_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_neg_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nextafter_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_celu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_elu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_embedding_bag_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_embedding_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_hardshrink_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_hardsigmoid_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_hardtanh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_linear_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_logsigmoid_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_mish_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_prelu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_relu6_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_relu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_rms_norm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_rrelu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_selu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_silu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_softplus_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_softshrink_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_softsign_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_tanhshrink_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_threshold_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_polar_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_polygamma_polygamma_n_0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_polygamma_polygamma_n_1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_polygamma_polygamma_n_2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_polygamma_polygamma_n_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_polygamma_polygamma_n_4_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_positive_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_pow_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_prod_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_rad2deg_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_real_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_reciprocal_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_remainder_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_round_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_round_decimals_0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_round_decimals_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_round_decimals_neg_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_rsqrt_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_rsub_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_select_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_sgn_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_short_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_sigmoid_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_sign_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_signbit_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_sin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_sinc_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_sinh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_airy_ai_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_bessel_j0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_bessel_j1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_bessel_y0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_bessel_y1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_chebyshev_polynomial_t_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_chebyshev_polynomial_u_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_chebyshev_polynomial_v_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_chebyshev_polynomial_w_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_entr_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_erfcx_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_hermite_polynomial_h_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_hermite_polynomial_he_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_i0e_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_i1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_i1e_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_laguerre_polynomial_l_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_legendre_polynomial_p_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_log_ndtr_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_modified_bessel_i0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_modified_bessel_i1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_modified_bessel_k0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_modified_bessel_k1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_ndtr_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_ndtri_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_polygamma_special_polygamma_n_0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_scaled_modified_bessel_k0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_scaled_modified_bessel_k1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_shifted_chebyshev_polynomial_t_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_shifted_chebyshev_polynomial_u_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_shifted_chebyshev_polynomial_v_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_shifted_chebyshev_polynomial_w_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_spherical_bessel_j0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_xlog1py_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_zeta_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_split_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_split_with_sizes_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_sqrt_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_square_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_squeeze_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_std_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_std_unbiased_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_sub_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_sum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_tan_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_tanh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_to_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_true_divide_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_trunc_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_unflatten_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_unsqueeze_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_var_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_var_unbiased_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_where_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_xlogy_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward___radd___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward___rdiv___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward___rmod___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward___rmul___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward___rpow___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward___rsub___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_abs_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_acos_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_acosh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_add_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_all_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_amax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_amin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_angle_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_any_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_argmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_argmin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_asin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_asinh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_atan2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_atan_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_atanh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_bfloat16_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_bmm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_bool_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_byte_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_cdouble_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_ceil_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_cfloat_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_chalf_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_char_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_chunk_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_clamp_max_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_clamp_min_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_clone_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_complex_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_conj_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_conj_physical_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_copysign_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_cos_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_cosh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_count_nonzero_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_deg2rad_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_digamma_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_div_floor_rounding_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_div_no_rounding_mode_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_div_trunc_rounding_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_double_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_eq_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_erf_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_erfc_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_erfinv_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_exp2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_exp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_expm1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_fill_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_float_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_float_power_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_floor_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_floor_divide_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_fmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_fmin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_fmod_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_frac_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_frexp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_ge_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_gt_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_half_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_heaviside_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_hypot_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_i0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_igamma_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_igammac_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_index_put_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_int_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_isclose_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_isfinite_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_isinf_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_isnan_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_isneginf_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_isposinf_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_isreal_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_jiterator_binary_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_jiterator_binary_return_by_ref_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_jiterator_unary_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_ldexp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_le_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_lgamma_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_linalg_vector_norm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_log10_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_log1p_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_log2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_log_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_logaddexp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_logical_and_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_logical_not_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_logical_or_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_logical_xor_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_logit_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_long_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_lt_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_masked_amax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_masked_amin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_masked_argmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_masked_argmin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_masked_logsumexp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_masked_mean_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_masked_norm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_masked_prod_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_masked_select_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_masked_std_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_masked_sum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_masked_var_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_matmul_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_max_binary_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_max_reduction_with_dim_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_maximum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_mean_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_min_binary_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_min_reduction_with_dim_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_minimum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_mul_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_mvlgamma_mvlgamma_p_1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_mvlgamma_mvlgamma_p_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_mvlgamma_mvlgamma_p_5_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nan_to_num_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nanmean_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nansum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_narrow_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_ne_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_neg_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nextafter_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_celu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_elu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_embedding_bag_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_embedding_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_hardshrink_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_hardsigmoid_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_hardtanh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_linear_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_logsigmoid_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_mish_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_prelu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_relu6_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_relu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_rms_norm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_rrelu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_selu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_silu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_softplus_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_softshrink_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_softsign_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_tanhshrink_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_threshold_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_polar_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_polygamma_polygamma_n_0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_polygamma_polygamma_n_1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_polygamma_polygamma_n_2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_polygamma_polygamma_n_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_polygamma_polygamma_n_4_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_positive_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_pow_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_prod_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_rad2deg_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_real_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_reciprocal_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_remainder_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_round_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_round_decimals_0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_round_decimals_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_round_decimals_neg_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_rsqrt_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_rsub_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_select_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_sgn_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_short_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_sigmoid_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_sign_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_signbit_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_sin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_sinc_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_sinh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_airy_ai_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_bessel_j0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_bessel_j1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_bessel_y0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_bessel_y1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_chebyshev_polynomial_t_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_chebyshev_polynomial_u_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_chebyshev_polynomial_v_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_chebyshev_polynomial_w_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_entr_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_erfcx_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_hermite_polynomial_h_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_hermite_polynomial_he_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_i0e_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_i1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_i1e_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_laguerre_polynomial_l_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_legendre_polynomial_p_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_log_ndtr_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_modified_bessel_i0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_modified_bessel_i1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_modified_bessel_k0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_modified_bessel_k1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_ndtr_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_ndtri_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_polygamma_special_polygamma_n_0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_scaled_modified_bessel_k0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_scaled_modified_bessel_k1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_shifted_chebyshev_polynomial_t_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_shifted_chebyshev_polynomial_u_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_shifted_chebyshev_polynomial_v_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_shifted_chebyshev_polynomial_w_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_spherical_bessel_j0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_xlog1py_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_zeta_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_split_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_split_with_sizes_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_sqrt_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_square_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_squeeze_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_std_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_std_unbiased_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_sub_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_sum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_tan_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_tanh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_to_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_true_divide_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_trunc_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_unflatten_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_unsqueeze_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_var_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_var_unbiased_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_where_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_xlogy_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_nested_tensor_input_mutation_backward_cuda, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_nested_tensor_non_contiguous_mutation_cuda
2024-12-18T00:28:54.0559634Z 
2024-12-18T00:28:54.0560282Z test_nestedtensor.py::TestNestedTensor::test_2d_nested_tensor_batch_size_2_max_seq_len_3_vocab_size_10 PASSED [0.0059s] [  0%]
2024-12-18T00:28:54.0561487Z test_nestedtensor.py::TestNestedTensor::test_2d_nested_tensor_batch_size_2_max_seq_len_3_vocab_size_20 PASSED [0.0025s] [  0%]
2024-12-18T00:28:54.0562665Z test_nestedtensor.py::TestNestedTensor::test_2d_nested_tensor_batch_size_2_max_seq_len_5_vocab_size_10 PASSED [0.0025s] [  0%]
2024-12-18T00:28:54.0563827Z test_nestedtensor.py::TestNestedTensor::test_2d_nested_tensor_batch_size_2_max_seq_len_5_vocab_size_20 PASSED [0.0025s] [  0%]
2024-12-18T00:28:54.0565014Z test_nestedtensor.py::TestNestedTensor::test_2d_nested_tensor_batch_size_4_max_seq_len_3_vocab_size_10 PASSED [0.0029s] [  0%]
2024-12-18T00:28:54.0566172Z test_nestedtensor.py::TestNestedTensor::test_2d_nested_tensor_batch_size_4_max_seq_len_3_vocab_size_20 PASSED [0.0028s] [  0%]
2024-12-18T00:28:54.0567331Z test_nestedtensor.py::TestNestedTensor::test_2d_nested_tensor_batch_size_4_max_seq_len_5_vocab_size_10 PASSED [0.0028s] [  0%]
2024-12-18T00:28:54.0568492Z test_nestedtensor.py::TestNestedTensor::test_2d_nested_tensor_batch_size_4_max_seq_len_5_vocab_size_20 PASSED [0.0028s] [  0%]
2024-12-18T00:28:54.0569648Z test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_batch_size_2_max_seq_len_3_vocab_size_10 PASSED [0.0025s] [  0%]
2024-12-18T00:28:54.0570795Z test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_batch_size_2_max_seq_len_3_vocab_size_20 PASSED [0.0025s] [  0%]
2024-12-18T00:28:54.0571960Z test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_batch_size_2_max_seq_len_5_vocab_size_10 PASSED [0.0025s] [  0%]
2024-12-18T00:28:54.0573127Z test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_batch_size_2_max_seq_len_5_vocab_size_20 PASSED [0.0026s] [  0%]
2024-12-18T00:28:54.0574296Z test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_batch_size_4_max_seq_len_3_vocab_size_10 PASSED [0.0030s] [  0%]
2024-12-18T00:28:54.0575451Z test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_batch_size_4_max_seq_len_3_vocab_size_20 PASSED [0.0030s] [  0%]
2024-12-18T00:28:54.0576624Z test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_batch_size_4_max_seq_len_5_vocab_size_10 PASSED [0.0030s] [  0%]
2024-12-18T00:28:54.0577795Z test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_batch_size_4_max_seq_len_5_vocab_size_20 PASSED [0.0031s] [  1%]
2024-12-18T00:28:54.0579000Z test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_float_batch_size_2_max_seq_len_3_vocab_size_10 PASSED [0.0029s] [  1%]
2024-12-18T00:28:54.0580207Z test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_float_batch_size_2_max_seq_len_3_vocab_size_20 PASSED [0.0028s] [  1%]
2024-12-18T00:28:54.0581420Z test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_float_batch_size_2_max_seq_len_5_vocab_size_10 PASSED [0.0028s] [  1%]
2024-12-18T00:28:54.0582630Z test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_float_batch_size_2_max_seq_len_5_vocab_size_20 PASSED [0.0028s] [  1%]
2024-12-18T00:28:54.0583849Z test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_float_batch_size_4_max_seq_len_3_vocab_size_10 PASSED [0.0035s] [  1%]
2024-12-18T00:28:54.0585301Z test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_float_batch_size_4_max_seq_len_3_vocab_size_20 PASSED [0.0035s] [  1%]
2024-12-18T00:28:54.0586957Z test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_float_batch_size_4_max_seq_len_5_vocab_size_10 PASSED [0.0036s] [  1%]
2024-12-18T00:28:54.0588311Z test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_float_batch_size_4_max_seq_len_5_vocab_size_20 PASSED [0.0035s] [  1%]
2024-12-18T00:28:54.0589317Z test_nestedtensor.py::TestNestedTensor::test_cat PASSED [0.0137s]        [  1%]
2024-12-18T00:28:54.0590098Z test_nestedtensor.py::TestNestedTensor::test_copy_ PASSED [0.0112s]      [  1%]
2024-12-18T00:28:54.0590939Z test_nestedtensor.py::TestNestedTensor::test_default_nested_tensor PASSED [0.0028s] [  1%]
2024-12-18T00:28:54.0591777Z test_nestedtensor.py::TestNestedTensor::test_dim PASSED [0.0020s]        [  1%]
2024-12-18T00:28:54.0592554Z test_nestedtensor.py::TestNestedTensor::test_fill_ PASSED [0.0048s]      [  1%]
2024-12-18T00:28:54.0593357Z test_nestedtensor.py::TestNestedTensor::test_is_contiguous PASSED [0.0040s] [  1%]
2024-12-18T00:28:54.0594197Z test_nestedtensor.py::TestNestedTensor::test_like_functions_ones_like PASSED [0.0044s] [  1%]
2024-12-18T00:28:54.0595102Z test_nestedtensor.py::TestNestedTensor::test_like_functions_randn_like PASSED [0.0043s] [  2%]
2024-12-18T00:28:54.0596016Z test_nestedtensor.py::TestNestedTensor::test_like_functions_zeros_like PASSED [0.0045s] [  2%]
2024-12-18T00:28:54.0596892Z test_nestedtensor.py::TestNestedTensor::test_nested_namespace PASSED [0.0026s] [  2%]
2024-12-18T00:28:54.0597734Z test_nestedtensor.py::TestNestedTensor::test_nested_tensor PASSED [0.0019s] [  2%]
2024-12-18T00:28:54.0598596Z test_nestedtensor.py::TestNestedTensor::test_nested_tensor_matching_dim PASSED [0.0024s] [  2%]
2024-12-18T00:28:54.0599427Z test_nestedtensor.py::TestNestedTensor::test_numel PASSED [0.0027s]      [  2%]
2024-12-18T00:28:54.0600263Z test_nestedtensor.py::TestNestedTensor::test_repr_string PASSED [0.0056s] [  2%]
2024-12-18T00:28:54.0601059Z test_nestedtensor.py::TestNestedTensor::test_size PASSED [0.0020s]       [  2%]
2024-12-18T00:28:54.0601840Z test_nestedtensor.py::TestNestedTensor::test_size_dim PASSED [0.0035s]   [  2%]
2024-12-18T00:28:54.0602624Z test_nestedtensor.py::TestNestedTensor::test_stride PASSED [0.0020s]     [  2%]
2024-12-18T00:28:54.0603409Z test_nestedtensor.py::TestNestedTensor::test_to PASSED [0.0277s]         [  2%]
2024-12-18T00:28:54.0604268Z test_nestedtensor.py::TestNestedTensor::test_to_padded_tensor_on_empty_tensor PASSED [0.0021s] [  2%]
2024-12-18T00:28:54.0605147Z test_nestedtensor.py::TestNestedTensor::test_unbind_0 PASSED [0.0026s]   [  2%]
2024-12-18T00:28:54.0605927Z test_nestedtensor.py::TestNestedTensor::test_unbind_1 PASSED [0.0027s]   [  2%]
2024-12-18T00:28:54.0606700Z test_nestedtensor.py::TestNestedTensor::test_unbind_3 PASSED [0.0028s]   [  2%]
2024-12-18T00:28:54.0607477Z test_nestedtensor.py::TestNestedTensor::test_unbind_4 PASSED [0.0028s]   [  2%]
2024-12-18T00:28:54.0608269Z test_nestedtensor.py::TestNestedTensor::test_unbind_dim PASSED [0.0021s] [  3%]
2024-12-18T00:28:54.0609029Z test_nestedtensor.py::TestNestedTensor::test_zero_ PASSED [0.0033s]      [  3%]
2024-12-18T00:28:54.0609808Z test_nestedtensor.py::TestNestedInt::test_comparisons PASSED [0.0023s]   [  3%]
2024-12-18T00:28:54.0610611Z test_nestedtensor.py::TestNestedInt::test_with_factor PASSED [0.0019s]   [  3%]
2024-12-18T00:28:54.0611557Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_binary_ops_with_scalar_eq_cuda PASSED [0.0325s] [  3%]
2024-12-18T00:28:54.0612695Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_binary_ops_with_scalar_ge_cuda PASSED [0.0097s] [  3%]
2024-12-18T00:28:54.0613871Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_bmm_cpu_cuda_float32 SKIPPED [0.0019s] (Only runs on cpu) [  3%]
2024-12-18T00:28:54.0615076Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_bmm_cpu_cuda_float64 SKIPPED [0.0019s] (Only runs on cpu) [  3%]
2024-12-18T00:28:54.0616456Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_bmm_cuda_cuda_bfloat16 PASSED [0.0626s] [  3%]
2024-12-18T00:28:54.0617520Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_bmm_cuda_cuda_float16 PASSED [0.0182s] [  3%]
2024-12-18T00:28:54.0618576Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_bmm_cuda_cuda_float32 PASSED [0.0152s] [  3%]
2024-12-18T00:28:54.0619725Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_bmm_cuda_cuda_float64 PASSED [0.0158s] [  3%]
2024-12-18T00:28:54.0620840Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_bmm_noncontiguous_cuda_float32 PASSED [0.0063s] [  3%]
2024-12-18T00:28:54.0621978Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_bmm_noncontiguous_cuda_float64 PASSED [0.0050s] [  3%]
2024-12-18T00:28:54.0623061Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_clone_cuda_float16 PASSED [0.0906s] [  3%]
2024-12-18T00:28:54.0624072Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_clone_cuda_float32 PASSED [0.0114s] [  4%]
2024-12-18T00:28:54.0625134Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_contiguous_cuda_float16 PASSED [0.0027s] [  4%]
2024-12-18T00:28:54.0626205Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_contiguous_cuda_float32 PASSED [0.0026s] [  4%]
2024-12-18T00:28:54.0627270Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_detach_cuda_float16 PASSED [0.0054s] [  4%]
2024-12-18T00:28:54.0628395Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_detach_cuda_float32 PASSED [0.0048s] [  4%]
2024-12-18T00:28:54.0629501Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_detach_cuda_float64 PASSED [0.0312s] [  4%]
2024-12-18T00:28:54.0630537Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_device_checks_cuda PASSED [0.0021s] [  4%]
2024-12-18T00:28:54.0631605Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_dropout_jagged_cuda_float32 PASSED [0.0580s] [  4%]
2024-12-18T00:28:54.0632713Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_dropout_jagged_cuda_float64 PASSED [0.0227s] [  4%]
2024-12-18T00:28:54.0633864Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_dropout_noncontiguous_cuda_float32 PASSED [0.0049s] [  4%]
2024-12-18T00:28:54.0635057Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_dropout_noncontiguous_cuda_float64 PASSED [0.0049s] [  4%]
2024-12-18T00:28:54.0636210Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_dropout_strided_cuda_float32 PASSED [0.0155s] [  4%]
2024-12-18T00:28:54.0637328Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_dropout_strided_cuda_float64 PASSED [0.0154s] [  4%]
2024-12-18T00:28:54.0638401Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_embedding_jagged_cuda PASSED [0.0160s] [  4%]
2024-12-18T00:28:54.0639459Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_embedding_strided_cuda PASSED [0.0088s] [  4%]
2024-12-18T00:28:54.0640527Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_empty_like_cuda_float16 PASSED [0.0045s] [  4%]
2024-12-18T00:28:54.0641938Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_empty_like_cuda_float32 PASSED [0.0044s] [  5%]
2024-12-18T00:28:54.0643026Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_empty_like_cuda_float64 PASSED [0.0043s] [  5%]
2024-12-18T00:28:54.0644145Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_layer_norm_breaking_cuda_float16 PASSED [0.0037s] [  5%]
2024-12-18T00:28:54.0645312Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_layer_norm_breaking_cuda_float32 PASSED [0.0033s] [  5%]
2024-12-18T00:28:54.0646407Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_layer_norm_cuda_float16 PASSED [0.0937s] [  5%]
2024-12-18T00:28:54.0647474Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_layer_norm_cuda_float32 PASSED [0.0953s] [  5%]
2024-12-18T00:28:54.0648526Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_linear_cuda_float32 PASSED [0.0054s] [  5%]
2024-12-18T00:28:54.0649698Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_linear_cuda_float64 PASSED [0.0038s] [  5%]
2024-12-18T00:28:54.0650812Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_linear_noncontiguous_cuda_float32 PASSED [0.0029s] [  5%]
2024-12-18T00:28:54.0652070Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_linear_noncontiguous_cuda_float64 PASSED [0.0025s] [  5%]
2024-12-18T00:28:54.0653199Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_masked_fill_cuda_float16 PASSED [0.0051s] [  5%]
2024-12-18T00:28:54.0654286Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_masked_fill_cuda_float32 PASSED [0.0047s] [  5%]
2024-12-18T00:28:54.0655380Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_masked_fill_cuda_float64 PASSED [0.0049s] [  5%]
2024-12-18T00:28:54.0656884Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_matmul_cuda_float32 PASSED [0.0163s] [  5%]
2024-12-18T00:28:54.0657928Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_matmul_cuda_float64 PASSED [0.0134s] [  5%]
2024-12-18T00:28:54.0659050Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_matmul_noncontiguous_cuda_float32 PASSED [0.0055s] [  5%]
2024-12-18T00:28:54.0660240Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_matmul_noncontiguous_cuda_float64 PASSED [0.0055s] [  6%]
2024-12-18T00:28:54.0661438Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_matmul_nt_with_broadcasted_t_cuda_float32 PASSED [0.0050s] [  6%]
2024-12-18T00:28:54.0662671Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_matmul_nt_with_broadcasted_t_cuda_float64 PASSED [0.0051s] [  6%]
2024-12-18T00:28:54.0663874Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_matmul_with_bmm_path_cuda_float32 PASSED [0.0194s] [  6%]
2024-12-18T00:28:54.0665037Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_matmul_with_bmm_path_cuda_float64 PASSED [0.0193s] [  6%]
2024-12-18T00:28:54.0666136Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_narrow_cuda_float16 PASSED [0.0137s] [  6%]
2024-12-18T00:28:54.0667186Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_narrow_cuda_float32 PASSED [0.0133s] [  6%]
2024-12-18T00:28:54.0668233Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_narrow_cuda_float64 PASSED [0.0132s] [  6%]
2024-12-18T00:28:54.0669287Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_masked_select_cuda PASSED [0.0104s] [  6%]
2024-12-18T00:28:54.0670444Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_add_in_place_cuda_float16 PASSED [0.0042s] [  6%]
2024-12-18T00:28:54.0671662Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_add_in_place_cuda_float32 PASSED [0.0041s] [  6%]
2024-12-18T00:28:54.0672915Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_add_transpose_False_cuda_float16 PASSED [0.0042s] [  6%]
2024-12-18T00:28:54.0674202Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_add_transpose_False_cuda_float32 PASSED [0.0042s] [  6%]
2024-12-18T00:28:54.0675489Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_add_transpose_True_cuda_float16 PASSED [0.0047s] [  6%]
2024-12-18T00:28:54.0676761Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_add_transpose_True_cuda_float32 PASSED [0.0047s] [  6%]
2024-12-18T00:28:54.0677969Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_chunk_cuda_float16 PASSED [0.0107s] [  7%]
2024-12-18T00:28:54.0679125Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_chunk_cuda_float32 PASSED [0.0096s] [  7%]
2024-12-18T00:28:54.0680276Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_chunk_cuda_float64 PASSED [0.0096s] [  7%]
2024-12-18T00:28:54.0681573Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_dense_elementwise_embedding_dim_128_cuda_float16 PASSED [0.0680s] [  7%]
2024-12-18T00:28:54.0683208Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_dense_elementwise_embedding_dim_128_cuda_float32 PASSED [0.0673s] [  7%]
2024-12-18T00:28:54.0684643Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_dense_elementwise_embedding_dim_256_cuda_float16 PASSED [0.0675s] [  7%]
2024-12-18T00:28:54.0686209Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_dense_elementwise_embedding_dim_256_cuda_float32 PASSED [0.0674s] [  7%]
2024-12-18T00:28:54.0687662Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_dense_elementwise_embedding_dim_384_cuda_float16 PASSED [0.0678s] [  7%]
2024-12-18T00:28:54.0689089Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_dense_elementwise_embedding_dim_384_cuda_float32 PASSED [0.0673s] [  7%]
2024-12-18T00:28:54.0690517Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_dense_elementwise_embedding_dim_8_cuda_float16 PASSED [0.0671s] [  7%]
2024-12-18T00:28:54.0691950Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_dense_elementwise_embedding_dim_8_cuda_float32 PASSED [0.0669s] [  7%]
2024-12-18T00:28:54.0693227Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_div_cuda_float16 PASSED [0.0110s] [  7%]
2024-12-18T00:28:54.0694366Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_div_cuda_float32 PASSED [0.0102s] [  7%]
2024-12-18T00:28:54.0695527Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_indexing_cuda_float16 PASSED [0.0159s] [  7%]
2024-12-18T00:28:54.0696733Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_indexing_cuda_float32 PASSED [0.0156s] [  7%]
2024-12-18T00:28:54.0697897Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_indexing_cuda_float64 PASSED [0.0155s] [  7%]
2024-12-18T00:28:54.0699162Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_indexing_noncontiguous_cuda_float16 PASSED [0.0049s] [  8%]
2024-12-18T00:28:54.0700558Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_indexing_noncontiguous_cuda_float32 PASSED [0.0048s] [  8%]
2024-12-18T00:28:54.0701886Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_indexing_noncontiguous_cuda_float64 PASSED [0.0049s] [  8%]
2024-12-18T00:28:54.0703141Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_mul_cuda_float16 PASSED [0.0116s] [  8%]
2024-12-18T00:28:54.0704280Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_mul_cuda_float32 PASSED [0.0111s] [  8%]
2024-12-18T00:28:54.0705452Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_mul_in_place_cuda_float16 PASSED [0.0084s] [  8%]
2024-12-18T00:28:54.0706662Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_mul_in_place_cuda_float32 PASSED [0.0082s] [  8%]
2024-12-18T00:28:54.0707876Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_split_with_sizes_cuda_float16 PASSED [0.0103s] [  8%]
2024-12-18T00:28:54.0709137Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_split_with_sizes_cuda_float32 PASSED [0.0096s] [  8%]
2024-12-18T00:28:54.0710394Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_split_with_sizes_cuda_float64 PASSED [0.0096s] [  8%]
2024-12-18T00:28:54.0711663Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_sub_transpose_False_cuda_float16 PASSED [0.0041s] [  8%]
2024-12-18T00:28:54.0712951Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_sub_transpose_False_cuda_float32 PASSED [0.0042s] [  8%]
2024-12-18T00:28:54.0714221Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_sub_transpose_True_cuda_float16 PASSED [0.0052s] [  8%]
2024-12-18T00:28:54.0715489Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_sub_transpose_True_cuda_float32 PASSED [0.0051s] [  8%]
2024-12-18T00:28:54.0716883Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_sum_dim_cuda_float32 SKIPPED [0.0019s] (Only runs on cpu) [  8%]
2024-12-18T00:28:54.0718090Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_reshape_cuda_float16 PASSED [0.0051s] [  8%]
2024-12-18T00:28:54.0719233Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_reshape_cuda_float32 PASSED [0.0041s] [  9%]
2024-12-18T00:28:54.0720298Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_reshape_cuda_float64 PASSED [0.0041s] [  9%]
2024-12-18T00:28:54.0721458Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_scaled_dot_product_attention_input_dim_3_cuda PASSED [0.0174s] [  9%]
2024-12-18T00:28:54.0722731Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_scaled_dot_product_attention_input_dim_4_cuda PASSED [0.0083s] [  9%]
2024-12-18T00:28:54.0724108Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_False_weights_only_False_cuda_float16 PASSED [0.0110s] [  9%]
2024-12-18T00:28:54.0725571Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_False_weights_only_False_cuda_float32 PASSED [0.0103s] [  9%]
2024-12-18T00:28:54.0727045Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_False_weights_only_False_cuda_float64 PASSED [0.0102s] [  9%]
2024-12-18T00:28:54.0728517Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_False_weights_only_True_cuda_float16 PASSED [0.0112s] [  9%]
2024-12-18T00:28:54.0729980Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_False_weights_only_True_cuda_float32 PASSED [0.0110s] [  9%]
2024-12-18T00:28:54.0731458Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_False_weights_only_True_cuda_float64 PASSED [0.0110s] [  9%]
2024-12-18T00:28:54.0732930Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_True_weights_only_False_cuda_float16 PASSED [0.0104s] [  9%]
2024-12-18T00:28:54.0734398Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_True_weights_only_False_cuda_float32 PASSED [0.0102s] [  9%]
2024-12-18T00:28:54.0735862Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_True_weights_only_False_cuda_float64 PASSED [0.0102s] [  9%]
2024-12-18T00:28:54.0737316Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_True_weights_only_True_cuda_float16 PASSED [0.0110s] [  9%]
2024-12-18T00:28:54.0738747Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_True_weights_only_True_cuda_float32 PASSED [0.0110s] [  9%]
2024-12-18T00:28:54.0740197Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_True_weights_only_True_cuda_float64 PASSED [0.0110s] [ 10%]
2024-12-18T00:28:54.0741445Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_softmax_cuda_float32 PASSED [0.0203s] [ 10%]
2024-12-18T00:28:54.0742813Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_softmax_cuda_float64 PASSED [0.0064s] [ 10%]
2024-12-18T00:28:54.0743933Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_softmax_noncontiguous_cuda_float32 PASSED [0.0047s] [ 10%]
2024-12-18T00:28:54.0745128Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_softmax_noncontiguous_cuda_float64 PASSED [0.0047s] [ 10%]
2024-12-18T00:28:54.0746292Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_squeeze_unsqueeze_cuda_float16 PASSED [0.0148s] [ 10%]
2024-12-18T00:28:54.0747408Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_squeeze_unsqueeze_cuda_float32 PASSED [0.0141s] [ 10%]
2024-12-18T00:28:54.0748542Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_squeeze_unsqueeze_cuda_float64 PASSED [0.0141s] [ 10%]
2024-12-18T00:28:54.0749689Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim2_cuda_float16 PASSED [0.0033s] [ 10%]
2024-12-18T00:28:54.0750978Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim2_cuda_float32 PASSED [0.0032s] [ 10%]
2024-12-18T00:28:54.0752144Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim2_cuda_float64 PASSED [0.0032s] [ 10%]
2024-12-18T00:28:54.0753386Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim3_cuda_float16 PASSED [0.0033s] [ 10%]
2024-12-18T00:28:54.0754572Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim3_cuda_float32 PASSED [0.0033s] [ 10%]
2024-12-18T00:28:54.0755714Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim3_cuda_float64 PASSED [0.0033s] [ 10%]
2024-12-18T00:28:54.0757340Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim4_cuda_float16 PASSED [0.0033s] [ 10%]
2024-12-18T00:28:54.0758505Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim4_cuda_float32 PASSED [0.0036s] [ 10%]
2024-12-18T00:28:54.0759686Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim4_cuda_float64 PASSED [0.0037s] [ 11%]
2024-12-18T00:28:54.0760901Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_noncontiguous_cuda_float16 PASSED [0.0036s] [ 11%]
2024-12-18T00:28:54.0762185Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_noncontiguous_cuda_float32 PASSED [0.0034s] [ 11%]
2024-12-18T00:28:54.0763463Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_noncontiguous_cuda_float64 PASSED [0.0033s] [ 11%]
2024-12-18T00:28:54.0764691Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_output_size_cuda_float16 PASSED [0.0045s] [ 11%]
2024-12-18T00:28:54.0765925Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_output_size_cuda_float32 PASSED [0.0044s] [ 11%]
2024-12-18T00:28:54.0767155Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_simple_cuda_float16 PASSED [0.0042s] [ 11%]
2024-12-18T00:28:54.0768349Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_simple_cuda_float32 PASSED [0.0042s] [ 11%]
2024-12-18T00:28:54.0769586Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_zero_numel_errors_cuda_float16 PASSED [0.0024s] [ 11%]
2024-12-18T00:28:54.0770875Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_zero_numel_errors_cuda_float32 PASSED [0.0022s] [ 11%]
2024-12-18T00:28:54.0772175Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_zero_numel_errors_cuda_float64 PASSED [0.0022s] [ 11%]
2024-12-18T00:28:54.0773494Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_then_from_padded_tensor_no_transform0213_cuda_float32 PASSED [0.0049s] [ 11%]
2024-12-18T00:28:54.0774699Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_transpose_cuda_float16 PASSED [0.0038s] [ 11%]
2024-12-18T00:28:54.0775781Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_transpose_cuda_float32 PASSED [0.0037s] [ 11%]
2024-12-18T00:28:54.0776870Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_transpose_cuda_float64 PASSED [0.0036s] [ 11%]
2024-12-18T00:28:54.0778088Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_transpose_inference_mode_interaction_cuda_float16 PASSED [0.0045s] [ 11%]
2024-12-18T00:28:54.0779426Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_transpose_inference_mode_interaction_cuda_float32 PASSED [0.0045s] [ 12%]
2024-12-18T00:28:54.0780765Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_transpose_inference_mode_interaction_cuda_float64 PASSED [0.0045s] [ 12%]
2024-12-18T00:28:54.0781986Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_abs__cuda PASSED [0.0053s] [ 12%]
2024-12-18T00:28:54.0783020Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_abs_cuda PASSED [0.0051s] [ 12%]
2024-12-18T00:28:54.0784247Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_cos_cuda PASSED [0.0059s] [ 12%]
2024-12-18T00:28:54.0785297Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_gelu__cuda PASSED [0.0071s] [ 12%]
2024-12-18T00:28:54.0786463Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_gelu_cuda PASSED [0.0052s] [ 12%]
2024-12-18T00:28:54.0787542Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_isinf_cuda PASSED [0.0039s] [ 12%]
2024-12-18T00:28:54.0788608Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_isnan_cuda PASSED [0.0037s] [ 12%]
2024-12-18T00:28:54.0789675Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_isneginf_cuda PASSED [0.0036s] [ 12%]
2024-12-18T00:28:54.0790759Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_isposinf_cuda PASSED [0.0037s] [ 12%]
2024-12-18T00:28:54.0791862Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_logical_not_cuda PASSED [0.0124s] [ 12%]
2024-12-18T00:28:54.0792962Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_neg_cuda PASSED [0.0053s] [ 12%]
2024-12-18T00:28:54.0794020Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_relu__cuda PASSED [0.0053s] [ 12%]
2024-12-18T00:28:54.0795079Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_relu_cuda PASSED [0.0052s] [ 12%]
2024-12-18T00:28:54.0796129Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_sgn_cuda PASSED [0.0052s] [ 13%]
2024-12-18T00:28:54.0797167Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_silu__cuda PASSED [0.0071s] [ 13%]
2024-12-18T00:28:54.0798221Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_silu_cuda PASSED [0.0052s] [ 13%]
2024-12-18T00:28:54.0799271Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_sin_cuda PASSED [0.0058s] [ 13%]
2024-12-18T00:28:54.0800378Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_sqrt_cuda PASSED [0.0052s] [ 13%]
2024-12-18T00:28:54.0801435Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_tanh__cuda PASSED [0.0057s] [ 13%]
2024-12-18T00:28:54.0802498Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_tanh_cuda PASSED [0.0051s] [ 13%]
2024-12-18T00:28:54.0803614Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unbind_noncontiguous_cuda_float16 PASSED [0.0050s] [ 13%]
2024-12-18T00:28:54.0804778Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unbind_noncontiguous_cuda_float32 PASSED [0.0050s] [ 13%]
2024-12-18T00:28:54.0805954Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unbind_noncontiguous_cuda_float64 PASSED [0.0051s] [ 13%]
2024-12-18T00:28:54.0807068Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_view_cuda_float16 PASSED [0.0047s] [ 13%]
2024-12-18T00:28:54.0808095Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_view_cuda_float32 PASSED [0.0042s] [ 13%]
2024-12-18T00:28:54.0809141Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_view_cuda_float64 PASSED [0.0042s] [ 13%]
2024-12-18T00:28:54.0810291Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_view_inference_mode_interaction_cuda_float16 PASSED [0.0045s] [ 13%]
2024-12-18T00:28:54.0811556Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_view_inference_mode_interaction_cuda_float32 PASSED [0.0045s] [ 13%]
2024-12-18T00:28:54.0812835Z test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_view_inference_mode_interaction_cuda_float64 PASSED [0.0045s] [ 13%]
2024-12-18T00:28:54.0813998Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_abs_backward_cuda PASSED [0.0421s] [ 14%]
2024-12-18T00:28:54.0815096Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_accumulate_grad_different_strides_cuda PASSED [0.0291s] [ 14%]
2024-12-18T00:28:54.0816313Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_as_nested_tensor_propagates_gradients_cuda PASSED [0.0048s] [ 14%]
2024-12-18T00:28:54.0817596Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_backward_add_strided_cuda PASSED [0.0150s] [ 14%]
2024-12-18T00:28:54.0818666Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_backward_for_add_op_cuda PASSED [0.0116s] [ 14%]
2024-12-18T00:28:54.0819790Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_backward_for_sub_op_cuda PASSED [0.0095s] [ 14%]
2024-12-18T00:28:54.0820876Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_backward_sub_strided_cuda PASSED [0.0171s] [ 14%]
2024-12-18T00:28:54.0821959Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_dropout_backward_jagged_cuda PASSED [0.0106s] [ 14%]
2024-12-18T00:28:54.0823059Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_dropout_backward_strided_cuda PASSED [0.0090s] [ 14%]
2024-12-18T00:28:54.0824112Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_gelu_backward_cuda PASSED [0.0190s] [ 14%]
2024-12-18T00:28:54.0825150Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_indexing_backward_cuda PASSED [0.0101s] [ 14%]
2024-12-18T00:28:54.0826248Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_5d_size_128_cuda PASSED [0.0722s] [ 14%]
2024-12-18T00:28:54.0827382Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_5d_size_2_cuda PASSED [0.0155s] [ 14%]
2024-12-18T00:28:54.0828533Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_5d_size_32_cuda PASSED [0.0184s] [ 14%]
2024-12-18T00:28:54.0829682Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_5d_size_4_cuda PASSED [0.0152s] [ 14%]
2024-12-18T00:28:54.0830822Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_edge_case_cuda PASSED [0.0026s] [ 14%]
2024-12-18T00:28:54.0831959Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_size_1023_cuda PASSED [0.0151s] [ 15%]
2024-12-18T00:28:54.0833102Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_size_1024_cuda PASSED [0.0150s] [ 15%]
2024-12-18T00:28:54.0834238Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_size_128_cuda PASSED [0.0148s] [ 15%]
2024-12-18T00:28:54.0835347Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_size_256_cuda PASSED [0.0147s] [ 15%]
2024-12-18T00:28:54.0836463Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_size_2_cuda PASSED [0.0143s] [ 15%]
2024-12-18T00:28:54.0837573Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_size_32_cuda PASSED [0.0145s] [ 15%]
2024-12-18T00:28:54.0838689Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_size_4_cuda PASSED [0.0143s] [ 15%]
2024-12-18T00:28:54.0839803Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_size_512_cuda PASSED [0.0147s] [ 15%]
2024-12-18T00:28:54.0840931Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_size_513_cuda PASSED [0.0146s] [ 15%]
2024-12-18T00:28:54.0842021Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_masked_fill_backward_cuda PASSED [0.0139s] [ 15%]
2024-12-18T00:28:54.0843090Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_bmm_backward_cuda PASSED [0.0053s] [ 15%]
2024-12-18T00:28:54.0844217Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_bmm_gradcheck_cuda PASSED [0.1885s] [ 15%]
2024-12-18T00:28:54.0845325Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_from_list_cuda PASSED [0.0125s] [ 15%]
2024-12-18T00:28:54.0846479Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_from_mask_and_to_padded_cuda PASSED [0.0104s] [ 15%]
2024-12-18T00:28:54.0847641Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_from_padded_cuda PASSED [0.0087s] [ 15%]
2024-12-18T00:28:54.0848790Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_from_padded_fused_cuda PASSED [0.0092s] [ 15%]
2024-12-18T00:28:54.0850045Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_generates_leaf_cuda PASSED [0.0039s] [ 16%]
2024-12-18T00:28:54.0851161Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_linear_backward_cuda PASSED [0.0029s] [ 16%]
2024-12-18T00:28:54.0852338Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_linear_cuda PASSED [0.0335s] [ 16%]
2024-12-18T00:28:54.0853489Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_linear_plus_transpose_cuda PASSED [0.0359s] [ 16%]
2024-12-18T00:28:54.0854667Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_matmul_backward_cuda PASSED [0.0068s] [ 16%]
2024-12-18T00:28:54.0855817Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_matmul_gradcheck_cuda PASSED [0.3305s] [ 16%]
2024-12-18T00:28:54.0857457Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_reshape_backward_cuda PASSED [0.0029s] [ 16%]
2024-12-18T00:28:54.0858633Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_reshape_gradcheck_cuda PASSED [0.0904s] [ 16%]
2024-12-18T00:28:54.0859735Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_softmax_cuda PASSED [0.0142s] [ 16%]
2024-12-18T00:28:54.0860864Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_squeeze_backward_cuda PASSED [0.0037s] [ 16%]
2024-12-18T00:28:54.0862024Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_squeeze_gradcheck_cuda PASSED [0.0933s] [ 16%]
2024-12-18T00:28:54.0863204Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_to_padded_tensor_cuda PASSED [0.0063s] [ 16%]
2024-12-18T00:28:54.0864379Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_transpose_backward_cuda PASSED [0.0036s] [ 16%]
2024-12-18T00:28:54.0865565Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_transpose_gradcheck_cuda PASSED [0.0635s] [ 16%]
2024-12-18T00:28:54.0866759Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_unsqueeze_backward_cuda PASSED [0.0039s] [ 16%]
2024-12-18T00:28:54.0867925Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_unsqueeze_gradcheck_cuda PASSED [0.0917s] [ 17%]
2024-12-18T00:28:54.0869037Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_relu_backward_cuda PASSED [0.0162s] [ 17%]
2024-12-18T00:28:54.0870052Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_selu_backward_cuda PASSED [0.0129s] [ 17%]
2024-12-18T00:28:54.0871120Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_set_requires_grad_from_list_cuda PASSED [0.0020s] [ 17%]
2024-12-18T00:28:54.0872237Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_set_requires_grad_from_mask_cuda PASSED [0.0025s] [ 17%]
2024-12-18T00:28:54.0873369Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_split_with_sizes_flow_through_cuda PASSED [0.0211s] [ 17%]
2024-12-18T00:28:54.0874568Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_to_buffer_series_ops_grad_with_broadcast_cuda PASSED [0.0115s] [ 17%]
2024-12-18T00:28:54.0875701Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_unbind_flow_through_cuda PASSED [0.0123s] [ 17%]
2024-12-18T00:28:54.0876798Z test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_values_grad_with_broadcast_cuda PASSED [0.0107s] [ 17%]
2024-12-18T00:28:54.0877895Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_apply__cuda_float32 PASSED [0.0032s] [ 17%]
2024-12-18T00:28:54.0879255Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_False_contiguous_False_cuda_float16 PASSED [0.0019s] [ 17%]
2024-12-18T00:28:54.0880962Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_False_contiguous_False_cuda_float32 PASSED [0.0018s] [ 17%]
2024-12-18T00:28:54.0882830Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_False_contiguous_False_cuda_float64 PASSED [0.0018s] [ 17%]
2024-12-18T00:28:54.0884679Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_False_contiguous_True_cuda_float16 PASSED [0.0018s] [ 17%]
2024-12-18T00:28:54.0886402Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_False_contiguous_True_cuda_float32 PASSED [0.0018s] [ 17%]
2024-12-18T00:28:54.0888058Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_False_contiguous_True_cuda_float64 PASSED [0.0018s] [ 17%]
2024-12-18T00:28:54.0889738Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_True_contiguous_False_cuda_float16 PASSED [0.0019s] [ 18%]
2024-12-18T00:28:54.0891419Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_True_contiguous_False_cuda_float32 PASSED [0.0018s] [ 18%]
2024-12-18T00:28:54.0893124Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_True_contiguous_False_cuda_float64 PASSED [0.0018s] [ 18%]
2024-12-18T00:28:54.0894804Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_True_contiguous_True_cuda_float16 PASSED [0.0019s] [ 18%]
2024-12-18T00:28:54.0896493Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_True_contiguous_True_cuda_float32 PASSED [0.0018s] [ 18%]
2024-12-18T00:28:54.0898158Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_True_contiguous_True_cuda_float64 PASSED [0.0018s] [ 18%]
2024-12-18T00:28:54.0899894Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_False_contiguous_False_cuda_float16 PASSED [0.0018s] [ 18%]
2024-12-18T00:28:54.0901611Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_False_contiguous_False_cuda_float32 PASSED [0.0018s] [ 18%]
2024-12-18T00:28:54.0903315Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_False_contiguous_False_cuda_float64 PASSED [0.0018s] [ 18%]
2024-12-18T00:28:54.0905001Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_False_contiguous_True_cuda_float16 PASSED [0.0018s] [ 18%]
2024-12-18T00:28:54.0906708Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_False_contiguous_True_cuda_float32 PASSED [0.0018s] [ 18%]
2024-12-18T00:28:54.0908453Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_False_contiguous_True_cuda_float64 PASSED [0.0018s] [ 18%]
2024-12-18T00:28:54.0910158Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_True_contiguous_False_cuda_float16 PASSED [0.0018s] [ 18%]
2024-12-18T00:28:54.0911853Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_True_contiguous_False_cuda_float32 PASSED [0.0018s] [ 18%]
2024-12-18T00:28:54.0913549Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_True_contiguous_False_cuda_float64 PASSED [0.0020s] [ 18%]
2024-12-18T00:28:54.0915236Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_True_contiguous_True_cuda_float16 PASSED [0.0018s] [ 18%]
2024-12-18T00:28:54.0917029Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_True_contiguous_True_cuda_float32 PASSED [0.0018s] [ 19%]
2024-12-18T00:28:54.0918787Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_True_contiguous_True_cuda_float64 PASSED [0.0018s] [ 19%]
2024-12-18T00:28:54.0920490Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_False_contiguous_False_cuda_float16 PASSED [0.0018s] [ 19%]
2024-12-18T00:28:54.0922206Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_False_contiguous_False_cuda_float32 PASSED [0.0018s] [ 19%]
2024-12-18T00:28:54.0923905Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_False_contiguous_False_cuda_float64 PASSED [0.0019s] [ 19%]
2024-12-18T00:28:54.0925605Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_False_contiguous_True_cuda_float16 PASSED [0.0018s] [ 19%]
2024-12-18T00:28:54.0927307Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_False_contiguous_True_cuda_float32 PASSED [0.0018s] [ 19%]
2024-12-18T00:28:54.0928991Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_False_contiguous_True_cuda_float64 PASSED [0.0019s] [ 19%]
2024-12-18T00:28:54.0930668Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_True_contiguous_False_cuda_float16 PASSED [0.0018s] [ 19%]
2024-12-18T00:28:54.0932345Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_True_contiguous_False_cuda_float32 PASSED [0.0018s] [ 19%]
2024-12-18T00:28:54.0934030Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_True_contiguous_False_cuda_float64 PASSED [0.0019s] [ 19%]
2024-12-18T00:28:54.0935714Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_True_contiguous_True_cuda_float16 PASSED [0.0018s] [ 19%]
2024-12-18T00:28:54.0937383Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_True_contiguous_True_cuda_float32 PASSED [0.0018s] [ 19%]
2024-12-18T00:28:54.0939082Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_True_contiguous_True_cuda_float64 PASSED [0.0019s] [ 19%]
2024-12-18T00:28:54.0940755Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_False_contiguous_False_cuda_float16 PASSED [0.0018s] [ 19%]
2024-12-18T00:28:54.0942472Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_False_contiguous_False_cuda_float32 PASSED [0.0018s] [ 20%]
2024-12-18T00:28:54.0944188Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_False_contiguous_False_cuda_float64 PASSED [0.0018s] [ 20%]
2024-12-18T00:28:54.0945896Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_False_contiguous_True_cuda_float16 PASSED [0.0018s] [ 20%]
2024-12-18T00:28:54.0947594Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_False_contiguous_True_cuda_float32 PASSED [0.0019s] [ 20%]
2024-12-18T00:28:54.0949289Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_False_contiguous_True_cuda_float64 PASSED [0.0018s] [ 20%]
2024-12-18T00:28:54.0951105Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_True_contiguous_False_cuda_float16 PASSED [0.0018s] [ 20%]
2024-12-18T00:28:54.0952887Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_True_contiguous_False_cuda_float32 PASSED [0.0019s] [ 20%]
2024-12-18T00:28:54.0954613Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_True_contiguous_False_cuda_float64 PASSED [0.0018s] [ 20%]
2024-12-18T00:28:54.0956942Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_True_contiguous_True_cuda_float16 PASSED [0.0018s] [ 20%]
2024-12-18T00:28:54.0958673Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_True_contiguous_True_cuda_float32 PASSED [0.0019s] [ 20%]
2024-12-18T00:28:54.0960348Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_True_contiguous_True_cuda_float64 PASSED [0.0018s] [ 20%]
2024-12-18T00:28:54.0962036Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_False_contiguous_False_cuda_float16 PASSED [0.0101s] [ 20%]
2024-12-18T00:28:54.0963721Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_False_contiguous_False_cuda_float32 PASSED [0.0090s] [ 20%]
2024-12-18T00:28:54.0965408Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_False_contiguous_False_cuda_float64 PASSED [0.0090s] [ 20%]
2024-12-18T00:28:54.0967112Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_False_contiguous_True_cuda_float16 PASSED [0.0089s] [ 20%]
2024-12-18T00:28:54.0968791Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_False_contiguous_True_cuda_float32 PASSED [0.0088s] [ 20%]
2024-12-18T00:28:54.0970499Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_False_contiguous_True_cuda_float64 PASSED [0.0089s] [ 21%]
2024-12-18T00:28:54.0972185Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_True_contiguous_False_cuda_float16 PASSED [0.0124s] [ 21%]
2024-12-18T00:28:54.0973866Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_True_contiguous_False_cuda_float32 PASSED [0.0116s] [ 21%]
2024-12-18T00:28:54.0975552Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_True_contiguous_False_cuda_float64 PASSED [0.0118s] [ 21%]
2024-12-18T00:28:54.0977237Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_True_contiguous_True_cuda_float16 PASSED [0.0117s] [ 21%]
2024-12-18T00:28:54.0978908Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_True_contiguous_True_cuda_float32 PASSED [0.0117s] [ 21%]
2024-12-18T00:28:54.0980575Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_True_contiguous_True_cuda_float64 PASSED [0.0118s] [ 21%]
2024-12-18T00:28:54.0982261Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_False_contiguous_False_cuda_float16 PASSED [0.0051s] [ 21%]
2024-12-18T00:28:54.0984166Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_False_contiguous_False_cuda_float32 PASSED [0.0049s] [ 21%]
2024-12-18T00:28:54.0985994Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_False_contiguous_False_cuda_float64 PASSED [0.0049s] [ 21%]
2024-12-18T00:28:54.0987735Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_False_contiguous_True_cuda_float16 PASSED [0.0049s] [ 21%]
2024-12-18T00:28:54.0989429Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_False_contiguous_True_cuda_float32 PASSED [0.0048s] [ 21%]
2024-12-18T00:28:54.0991118Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_False_contiguous_True_cuda_float64 PASSED [0.0048s] [ 21%]
2024-12-18T00:28:54.0992821Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_True_contiguous_False_cuda_float16 PASSED [0.0061s] [ 21%]
2024-12-18T00:28:54.0994497Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_True_contiguous_False_cuda_float32 PASSED [0.0058s] [ 21%]
2024-12-18T00:28:54.0996195Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_True_contiguous_False_cuda_float64 PASSED [0.0060s] [ 21%]
2024-12-18T00:28:54.0997889Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_True_contiguous_True_cuda_float16 PASSED [0.0059s] [ 22%]
2024-12-18T00:28:54.0999569Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_True_contiguous_True_cuda_float32 PASSED [0.0057s] [ 22%]
2024-12-18T00:28:54.1001334Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_True_contiguous_True_cuda_float64 PASSED [0.0059s] [ 22%]
2024-12-18T00:28:54.1003026Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_False_contiguous_False_cuda_float16 PASSED [0.0094s] [ 22%]
2024-12-18T00:28:54.1004728Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_False_contiguous_False_cuda_float32 PASSED [0.0089s] [ 22%]
2024-12-18T00:28:54.1006422Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_False_contiguous_False_cuda_float64 PASSED [0.0090s] [ 22%]
2024-12-18T00:28:54.1008110Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_False_contiguous_True_cuda_float16 PASSED [0.0089s] [ 22%]
2024-12-18T00:28:54.1009804Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_False_contiguous_True_cuda_float32 PASSED [0.0088s] [ 22%]
2024-12-18T00:28:54.1011492Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_False_contiguous_True_cuda_float64 PASSED [0.0089s] [ 22%]
2024-12-18T00:28:54.1013158Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_True_contiguous_False_cuda_float16 PASSED [0.0119s] [ 22%]
2024-12-18T00:28:54.1014835Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_True_contiguous_False_cuda_float32 PASSED [0.0117s] [ 22%]
2024-12-18T00:28:54.1016533Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_True_contiguous_False_cuda_float64 PASSED [0.0117s] [ 22%]
2024-12-18T00:28:54.1018320Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_True_contiguous_True_cuda_float16 PASSED [0.0116s] [ 22%]
2024-12-18T00:28:54.1020103Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_True_contiguous_True_cuda_float32 PASSED [0.0114s] [ 22%]
2024-12-18T00:28:54.1021795Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_True_contiguous_True_cuda_float64 PASSED [0.0115s] [ 22%]
2024-12-18T00:28:54.1023484Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_False_contiguous_False_cuda_float16 PASSED [0.0050s] [ 23%]
2024-12-18T00:28:54.1025188Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_False_contiguous_False_cuda_float32 PASSED [0.0049s] [ 23%]
2024-12-18T00:28:54.1026903Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_False_contiguous_False_cuda_float64 PASSED [0.0050s] [ 23%]
2024-12-18T00:28:54.1028610Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_False_contiguous_True_cuda_float16 PASSED [0.0049s] [ 23%]
2024-12-18T00:28:54.1030285Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_False_contiguous_True_cuda_float32 PASSED [0.0049s] [ 23%]
2024-12-18T00:28:54.1032003Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_False_contiguous_True_cuda_float64 PASSED [0.0049s] [ 23%]
2024-12-18T00:28:54.1033698Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_True_contiguous_False_cuda_float16 PASSED [0.0060s] [ 23%]
2024-12-18T00:28:54.1035401Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_True_contiguous_False_cuda_float32 PASSED [0.0066s] [ 23%]
2024-12-18T00:28:54.1037112Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_True_contiguous_False_cuda_float64 PASSED [0.0060s] [ 23%]
2024-12-18T00:28:54.1038796Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_True_contiguous_True_cuda_float16 PASSED [0.0060s] [ 23%]
2024-12-18T00:28:54.1040473Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_True_contiguous_True_cuda_float32 PASSED [0.0058s] [ 23%]
2024-12-18T00:28:54.1042151Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_True_contiguous_True_cuda_float64 PASSED [0.0059s] [ 23%]
2024-12-18T00:28:54.1043839Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_False_contiguous_False_cuda_float16 PASSED [0.0091s] [ 23%]
2024-12-18T00:28:54.1045532Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_False_contiguous_False_cuda_float32 PASSED [0.0090s] [ 23%]
2024-12-18T00:28:54.1047240Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_False_contiguous_False_cuda_float64 PASSED [0.0091s] [ 23%]
2024-12-18T00:28:54.1048925Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_False_contiguous_True_cuda_float16 PASSED [0.0089s] [ 23%]
2024-12-18T00:28:54.1050608Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_False_contiguous_True_cuda_float32 PASSED [0.0087s] [ 24%]
2024-12-18T00:28:54.1052394Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_False_contiguous_True_cuda_float64 PASSED [0.0088s] [ 24%]
2024-12-18T00:28:54.1054168Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_True_contiguous_False_cuda_float16 PASSED [0.0119s] [ 24%]
2024-12-18T00:28:54.1055867Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_True_contiguous_False_cuda_float32 PASSED [0.0118s] [ 24%]
2024-12-18T00:28:54.1057828Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_True_contiguous_False_cuda_float64 PASSED [0.0120s] [ 24%]
2024-12-18T00:28:54.1059509Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_True_contiguous_True_cuda_float16 PASSED [0.0117s] [ 24%]
2024-12-18T00:28:54.1061191Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_True_contiguous_True_cuda_float32 PASSED [0.0117s] [ 24%]
2024-12-18T00:28:54.1062884Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_True_contiguous_True_cuda_float64 PASSED [0.0118s] [ 24%]
2024-12-18T00:28:54.1064576Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_False_contiguous_False_cuda_float16 PASSED [0.0051s] [ 24%]
2024-12-18T00:28:54.1066267Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_False_contiguous_False_cuda_float32 PASSED [0.0049s] [ 24%]
2024-12-18T00:28:54.1067985Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_False_contiguous_False_cuda_float64 PASSED [0.0050s] [ 24%]
2024-12-18T00:28:54.1069690Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_False_contiguous_True_cuda_float16 PASSED [0.0050s] [ 24%]
2024-12-18T00:28:54.1071388Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_False_contiguous_True_cuda_float32 PASSED [0.0049s] [ 24%]
2024-12-18T00:28:54.1073090Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_False_contiguous_True_cuda_float64 PASSED [0.0050s] [ 24%]
2024-12-18T00:28:54.1074777Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_True_contiguous_False_cuda_float16 PASSED [0.0060s] [ 24%]
2024-12-18T00:28:54.1076489Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_True_contiguous_False_cuda_float32 PASSED [0.0059s] [ 24%]
2024-12-18T00:28:54.1078189Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_True_contiguous_False_cuda_float64 PASSED [0.0060s] [ 25%]
2024-12-18T00:28:54.1079914Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_True_contiguous_True_cuda_float16 PASSED [0.0059s] [ 25%]
2024-12-18T00:28:54.1081602Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_True_contiguous_True_cuda_float32 PASSED [0.0058s] [ 25%]
2024-12-18T00:28:54.1083267Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_True_contiguous_True_cuda_float64 PASSED [0.0059s] [ 25%]
2024-12-18T00:28:54.1084914Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_autograd_function_with_None_grad_cuda_float32 PASSED [0.0080s] [ 25%]
2024-12-18T00:28:54.1086131Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_binary_pointwise_broadcasting_cuda PASSED [0.1380s] [ 25%]
2024-12-18T00:28:54.1087339Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_binary_pointwise_cuda PASSED [0.0332s] [ 25%]
2024-12-18T00:28:54.1088445Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_binary_pointwise_transposed_cuda PASSED [0.0451s] [ 25%]
2024-12-18T00:28:54.1089655Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_binary_pointwise_with_nested_int_second_arg_cuda PASSED [0.0035s] [ 25%]
2024-12-18T00:28:54.1090785Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_chunk_cuda PASSED [0.0284s] [ 25%]
2024-12-18T00:28:54.1092124Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_compile_padded_dense_conversion_preserves_metadata_cache_cuda_float32 SKIPPED [0.0018s] (GPU capability is < SM70) [ 25%]
2024-12-18T00:28:54.1093758Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_compile_preserves_metadata_cache_cuda_float32 SKIPPED [0.0018s] (GPU capability is < SM70) [ 25%]
2024-12-18T00:28:54.1095261Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_compile_with_dynamic_max_seq_len_cuda_float32 SKIPPED [0.0018s] (GPU capability is < SM70) [ 25%]
2024-12-18T00:28:54.1096745Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_compile_with_dynamic_min_seq_len_cuda_float32 SKIPPED [0.0018s] (GPU capability is < SM70) [ 25%]
2024-12-18T00:28:54.1098274Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_compile_with_propagated_dynamic_max_seq_len_cuda_float32 SKIPPED [0.0018s] (GPU capability is < SM70) [ 25%]
2024-12-18T00:28:54.1099684Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_composite_op_in_inference_mode_cuda_float32 PASSED [0.0070s] [ 26%]
2024-12-18T00:28:54.1100968Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_composite_op_with_custom_mode_cuda_float32 PASSED [0.0039s] [ 26%]
2024-12-18T00:28:54.1102172Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_construction_from_list_cuda_float32 PASSED [0.0148s] [ 26%]
2024-12-18T00:28:54.1103223Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_copy__cuda PASSED [0.0060s] [ 26%]
2024-12-18T00:28:54.1104329Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_device_dtype_transfer_updates_offsets_cuda_float16 PASSED [0.0099s] [ 26%]
2024-12-18T00:28:54.1105629Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_device_dtype_transfer_updates_offsets_cuda_float64 PASSED [0.0096s] [ 26%]
2024-12-18T00:28:54.1107018Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_dummy_mha_with_nt_use_legacy_api_False_cuda SKIPPED [0.0018s] (GPU capability is < SM70) [ 26%]
2024-12-18T00:28:54.1108445Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_dummy_mha_with_nt_use_legacy_api_True_cuda SKIPPED [0.0018s] (GPU capability is < SM70) [ 26%]
2024-12-18T00:28:54.1109679Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_flatten_decomp_cuda PASSED [0.0068s] [ 26%]
2024-12-18T00:28:54.1110986Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_flex_attention_converts_stacked_seq_indices_cuda_float32 SKIPPED [0.0003s] (Requires CUDA and Triton) [ 26%]
2024-12-18T00:28:54.1112678Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_flex_attention_noncontig_with_holes_False_cross_attention_False_cuda_float32 SKIPPED [0.0003s] (Requires CUDA and Triton) [ 26%]
2024-12-18T00:28:54.1114451Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_flex_attention_noncontig_with_holes_False_cross_attention_True_cuda_float32 SKIPPED [0.0004s] (Requires CUDA and Triton) [ 26%]
2024-12-18T00:28:54.1116075Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_flex_attention_noncontig_with_holes_True_cross_attention_False_cuda_float32 SKIPPED [0.0002s] [ 26%]
2024-12-18T00:28:54.1117593Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_flex_attention_noncontig_with_holes_True_cross_attention_True_cuda_float32 SKIPPED [0.0003s] [ 26%]
2024-12-18T00:28:54.1119914Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_index_put_error_cuda /var/lib/jenkins/workspace/aten/src/ATen/native/cuda/TensorCompare.cu:110: _assert_async_cuda_kernel: block: [0,0,0], thread: [0,0,0] Assertion `Some indices in the ragged dimension are out of bounds!` failed.
2024-12-18T00:28:54.1121537Z Traceback (most recent call last):
2024-12-18T00:28:54.1121957Z   File "<string>", line 12, in <module>
2024-12-18T00:28:54.1122828Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nested/_internal/nested_tensor.py", line 353, in __torch_function__
2024-12-18T00:28:54.1123690Z     return func(*args, **kwargs)
2024-12-18T00:28:54.1124497Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nested/_internal/nested_tensor.py", line 325, in __torch_dispatch__
2024-12-18T00:28:54.1125347Z     return fn(*args, **kwargs)
2024-12-18T00:28:54.1126064Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nested/_internal/ops.py", line 218, in inner
2024-12-18T00:28:54.1126812Z     return func(aten_op, *args, **kwargs)
2024-12-18T00:28:54.1127585Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nested/_internal/ops.py", line 1813, in index_put_
2024-12-18T00:28:54.1128484Z     ragged_indices = inp.offsets()[indices[0]] + indices[inp._ragged_idx]
2024-12-18T00:28:54.1129104Z RuntimeError: CUDA error: device-side assert triggered
2024-12-18T00:28:54.1129952Z CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.
2024-12-18T00:28:54.1130801Z For debugging consider passing CUDA_LAUNCH_BLOCKING=1
2024-12-18T00:28:54.1131413Z Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions.
2024-12-18T00:28:54.1131812Z 
2024-12-18T00:28:54.1131972Z PASSED [4.0779s] [ 26%]
2024-12-18T00:28:54.1132635Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_is_contiguous_cuda PASSED [0.0121s] [ 26%]
2024-12-18T00:28:54.1133639Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_is_same_size_cuda PASSED [0.0073s] [ 27%]
2024-12-18T00:28:54.1135174Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_as_nested_tensor_components_require_grad_False_cuda_float16 PASSED [0.0078s] [ 27%]
2024-12-18T00:28:54.1137029Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_as_nested_tensor_components_require_grad_False_cuda_float32 PASSED [0.0077s] [ 27%]
2024-12-18T00:28:54.1138672Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_as_nested_tensor_components_require_grad_False_cuda_float64 PASSED [0.0078s] [ 27%]
2024-12-18T00:28:54.1140307Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_as_nested_tensor_components_require_grad_True_cuda_float16 PASSED [0.0174s] [ 27%]
2024-12-18T00:28:54.1141941Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_as_nested_tensor_components_require_grad_True_cuda_float32 PASSED [0.0168s] [ 27%]
2024-12-18T00:28:54.1143579Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_as_nested_tensor_components_require_grad_True_cuda_float64 PASSED [0.0175s] [ 27%]
2024-12-18T00:28:54.1145298Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_False_components_require_grad_False_cuda_float16 PASSED [0.0100s] [ 27%]
2024-12-18T00:28:54.1147095Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_False_components_require_grad_False_cuda_float32 PASSED [0.0099s] [ 27%]
2024-12-18T00:28:54.1148870Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_False_components_require_grad_False_cuda_float64 PASSED [0.0100s] [ 27%]
2024-12-18T00:28:54.1150681Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_False_components_require_grad_True_cuda_float16 PASSED [0.0100s] [ 27%]
2024-12-18T00:28:54.1152604Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_False_components_require_grad_True_cuda_float32 PASSED [0.0100s] [ 27%]
2024-12-18T00:28:54.1154476Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_False_components_require_grad_True_cuda_float64 PASSED [0.0100s] [ 27%]
2024-12-18T00:28:54.1156749Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_True_components_require_grad_False_cuda_float16 PASSED [0.0189s] [ 27%]
2024-12-18T00:28:54.1158545Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_True_components_require_grad_False_cuda_float32 PASSED [0.0188s] [ 27%]
2024-12-18T00:28:54.1160337Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_True_components_require_grad_False_cuda_float64 PASSED [0.0188s] [ 27%]
2024-12-18T00:28:54.1162123Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_True_components_require_grad_True_cuda_float16 PASSED [0.0188s] [ 28%]
2024-12-18T00:28:54.1163903Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_True_components_require_grad_True_cuda_float32 PASSED [0.0188s] [ 28%]
2024-12-18T00:28:54.1165677Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_True_components_require_grad_True_cuda_float64 PASSED [0.0190s] [ 28%]
2024-12-18T00:28:54.1167233Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_with_pinned_memory_cuda PASSED [0.0116s] [ 28%]
2024-12-18T00:28:54.1168836Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_mean_keepdim_False_requires_grad_False_components_require_grad_False_cuda_float32 PASSED [0.0017s] [ 28%]
2024-12-18T00:28:54.1170740Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_mean_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32 PASSED [0.0017s] [ 28%]
2024-12-18T00:28:54.1172632Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_mean_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32 PASSED [0.0017s] [ 28%]
2024-12-18T00:28:54.1174519Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_mean_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32 PASSED [0.0018s] [ 28%]
2024-12-18T00:28:54.1176403Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_mean_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32 PASSED [0.0303s] [ 28%]
2024-12-18T00:28:54.1178313Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_mean_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32 PASSED [0.0237s] [ 28%]
2024-12-18T00:28:54.1180195Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_mean_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32 PASSED [0.0251s] [ 28%]
2024-12-18T00:28:54.1182067Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_mean_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32 PASSED [0.0252s] [ 28%]
2024-12-18T00:28:54.1183946Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_sum_keepdim_False_requires_grad_False_components_require_grad_False_cuda_float32 PASSED [0.0565s] [ 28%]
2024-12-18T00:28:54.1186023Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_sum_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32 PASSED [0.0565s] [ 28%]
2024-12-18T00:28:54.1188023Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_sum_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32 PASSED [0.0590s] [ 28%]
2024-12-18T00:28:54.1189896Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_sum_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32 PASSED [0.0590s] [ 28%]
2024-12-18T00:28:54.1191789Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_sum_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32 PASSED [0.0779s] [ 29%]
2024-12-18T00:28:54.1193659Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_sum_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32 PASSED [0.0884s] [ 29%]
2024-12-18T00:28:54.1195539Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_sum_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32 PASSED [0.0599s] [ 29%]
2024-12-18T00:28:54.1197405Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_sum_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32 PASSED [0.0599s] [ 29%]
2024-12-18T00:28:54.1199009Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_padded_dense_conversion_kernels_cuda_float16 PASSED [0.0040s] [ 29%]
2024-12-18T00:28:54.1200375Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_padded_dense_conversion_kernels_cuda_float32 PASSED [0.0038s] [ 29%]
2024-12-18T00:28:54.1201697Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_padded_dense_conversion_kernels_cuda_float64 PASSED [0.0039s] [ 29%]
2024-12-18T00:28:54.1203155Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_False_values_is_view_False_cuda_float16 PASSED [0.0040s] [ 29%]
2024-12-18T00:28:54.1204780Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_False_values_is_view_False_cuda_float32 PASSED [0.0040s] [ 29%]
2024-12-18T00:28:54.1206358Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_False_values_is_view_False_cuda_float64 PASSED [0.0039s] [ 29%]
2024-12-18T00:28:54.1207947Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_False_values_is_view_True_cuda_float16 PASSED [0.0040s] [ 29%]
2024-12-18T00:28:54.1209539Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_False_values_is_view_True_cuda_float32 PASSED [0.0039s] [ 29%]
2024-12-18T00:28:54.1211122Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_False_values_is_view_True_cuda_float64 PASSED [0.0040s] [ 29%]
2024-12-18T00:28:54.1212716Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_True_values_is_view_False_cuda_float16 PASSED [0.0066s] [ 29%]
2024-12-18T00:28:54.1214313Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_True_values_is_view_False_cuda_float32 PASSED [0.0065s] [ 29%]
2024-12-18T00:28:54.1215892Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_True_values_is_view_False_cuda_float64 PASSED [0.0064s] [ 30%]
2024-12-18T00:28:54.1217494Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_True_values_is_view_True_cuda_float16 PASSED [0.0065s] [ 30%]
2024-12-18T00:28:54.1219070Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_True_values_is_view_True_cuda_float32 PASSED [0.0065s] [ 30%]
2024-12-18T00:28:54.1220734Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_True_values_is_view_True_cuda_float64 PASSED [0.0065s] [ 30%]
2024-12-18T00:28:54.1222389Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_2d_input_requires_grad_False_components_require_grad_False_cuda_float32 PASSED [0.0080s] [ 30%]
2024-12-18T00:28:54.1223973Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_2d_input_requires_grad_False_components_require_grad_True_cuda_float32 PASSED [0.0072s] [ 30%]
2024-12-18T00:28:54.1225551Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_2d_input_requires_grad_True_components_require_grad_False_cuda_float32 PASSED [0.0073s] [ 30%]
2024-12-18T00:28:54.1227101Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_2d_input_requires_grad_True_components_require_grad_True_cuda_float32 PASSED [0.0073s] [ 30%]
2024-12-18T00:28:54.1228723Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_operate_on_batch_dim_requires_grad_False_components_require_grad_False_cuda_float32 PASSED [0.0090s] [ 30%]
2024-12-18T00:28:54.1230401Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_operate_on_batch_dim_requires_grad_False_components_require_grad_True_cuda_float32 PASSED [0.0089s] [ 30%]
2024-12-18T00:28:54.1232067Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_operate_on_batch_dim_requires_grad_True_components_require_grad_False_cuda_float32 PASSED [0.0091s] [ 30%]
2024-12-18T00:28:54.1233734Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_operate_on_batch_dim_requires_grad_True_components_require_grad_True_cuda_float32 PASSED [0.0092s] [ 30%]
2024-12-18T00:28:54.1235401Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_reduce_ragged_idx_1_requires_grad_False_components_require_grad_False_cuda_float32 PASSED [0.0204s] [ 30%]
2024-12-18T00:28:54.1237388Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_reduce_ragged_idx_1_requires_grad_False_components_require_grad_True_cuda_float32 PASSED [0.0197s] [ 30%]
2024-12-18T00:28:54.1239052Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_reduce_ragged_idx_1_requires_grad_True_components_require_grad_False_cuda_float32 PASSED [0.0207s] [ 30%]
2024-12-18T00:28:54.1240697Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_reduce_ragged_idx_1_requires_grad_True_components_require_grad_True_cuda_float32 PASSED [0.0207s] [ 30%]
2024-12-18T00:28:54.1242400Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_with_lengths_requires_grad_False_components_require_grad_False_cuda_float32 PASSED [0.0040s] [ 31%]
2024-12-18T00:28:54.1244013Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_with_lengths_requires_grad_False_components_require_grad_True_cuda_float32 PASSED [0.0036s] [ 31%]
2024-12-18T00:28:54.1245631Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_with_lengths_requires_grad_True_components_require_grad_False_cuda_float32 PASSED [0.0036s] [ 31%]
2024-12-18T00:28:54.1247237Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_with_lengths_requires_grad_True_components_require_grad_True_cuda_float32 PASSED [0.0037s] [ 31%]
2024-12-18T00:28:54.1248626Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layout_under_torch_dispatch_mode_cuda PASSED [0.0030s] [ 31%]
2024-12-18T00:28:54.1249753Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_like_shape_empty_like_cuda PASSED [0.0033s] [ 31%]
2024-12-18T00:28:54.1250814Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_like_shape_randn_like_cuda PASSED [0.0034s] [ 31%]
2024-12-18T00:28:54.1251879Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_like_value_ones_like_cuda PASSED [0.0036s] [ 31%]
2024-12-18T00:28:54.1252941Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_like_value_zeros_like_cuda PASSED [0.0035s] [ 31%]
2024-12-18T00:28:54.1255599Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_backward_memory_usage_cuda_float32 SKIPPED [0.0009s] (Test is disabled because an issue exists disabling it: https://github.com/pytorch/pytorch/issues/141292 for platform(s) rocm, linux. If you're seeing this on your local machine and would like to enable this test, please make sure CI is not set and you are not using the flag --import-disabled-tests.) [ 31%]
2024-12-18T00:28:54.1258350Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_nt_dim_3_cuda ('RERUN', {'yellow': True}) [0.0540s] [ 31%]
2024-12-18T00:28:54.1259526Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_nt_dim_3_cuda ('RERUN', {'yellow': True}) [0.0244s] [ 31%]
2024-12-18T00:28:54.1260631Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_nt_dim_3_cuda FAILED [0.0238s] [ 31%]
2024-12-18T00:28:54.1261213Z 
2024-12-18T00:28:54.1261428Z ==================================== RERUNS ====================================
2024-12-18T00:28:54.1262071Z ____________ TestNestedTensorSubclassCUDA.test_linear_nt_dim_3_cuda ____________
2024-12-18T00:28:54.1262672Z Traceback (most recent call last):
2024-12-18T00:28:54.1263311Z   File "/var/lib/jenkins/workspace/test/test_nestedtensor.py", line 3790, in test_linear
2024-12-18T00:28:54.1263954Z     gradcheck(
2024-12-18T00:28:54.1264692Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/testing/_internal/common_utils.py", line 4914, in gradcheck
2024-12-18T00:28:54.1265598Z     return torch.autograd.gradcheck(fn, inputs, **kwargs)
2024-12-18T00:28:54.1266421Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 2055, in gradcheck
2024-12-18T00:28:54.1267195Z     return _gradcheck_helper(**args)
2024-12-18T00:28:54.1268002Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 2084, in _gradcheck_helper
2024-12-18T00:28:54.1268817Z     _gradcheck_real_imag(
2024-12-18T00:28:54.1269597Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 1494, in _gradcheck_real_imag
2024-12-18T00:28:54.1270405Z     gradcheck_fn(
2024-12-18T00:28:54.1271103Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 1924, in _fast_gradcheck
2024-12-18T00:28:54.1271967Z     analytical_vJu = _get_analytical_vJu_backward_mode(
2024-12-18T00:28:54.1272923Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 807, in _get_analytical_vJu_backward_mode
2024-12-18T00:28:54.1273851Z     all_vJ = _check_analytical_jacobian_attributes(
2024-12-18T00:28:54.1274784Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 775, in _check_analytical_jacobian_attributes
2024-12-18T00:28:54.1275845Z     vjps1 = _get_analytical_vjps_wrt_specific_output(vjp_fn, output.clone(), v)
2024-12-18T00:28:54.1276897Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 909, in _get_analytical_vjps_wrt_specific_output
2024-12-18T00:28:54.1277867Z     grad_inputs = vjp_fn(v.reshape(sample_output.shape))
2024-12-18T00:28:54.1278677Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 769, in vjp_fn
2024-12-18T00:28:54.1279429Z     return torch.autograd.grad(
2024-12-18T00:28:54.1280199Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/__init__.py", line 496, in grad
2024-12-18T00:28:54.1281010Z     result = _engine_run_backward(
2024-12-18T00:28:54.1281849Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/graph.py", line 823, in _engine_run_backward
2024-12-18T00:28:54.1283022Z     return Variable._execution_engine.run_backward(  # Calls into the C++ engine to run the backward pass
2024-12-18T00:28:54.1284749Z RuntimeError: result2.storage().use_count() == 1 INTERNAL ASSERT FAILED at "/var/lib/jenkins/workspace/torch/csrc/autograd/generated/VariableType_3.cpp":11909, please report a bug to PyTorch. function: linear_backward
2024-12-18T00:28:54.1286206Z 
2024-12-18T00:28:54.1286480Z To execute this test, run the following from the base repo dir:
2024-12-18T00:28:54.1287417Z     python test/test_nestedtensor.py TestNestedTensorSubclassCUDA.test_linear_nt_dim_3_cuda
2024-12-18T00:28:54.1288014Z 
2024-12-18T00:28:54.1288355Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0
2024-12-18T00:28:54.1289182Z ____________ TestNestedTensorSubclassCUDA.test_linear_nt_dim_3_cuda ____________
2024-12-18T00:28:54.1289843Z Traceback (most recent call last):
2024-12-18T00:28:54.1290539Z   File "/var/lib/jenkins/workspace/test/test_nestedtensor.py", line 3790, in test_linear
2024-12-18T00:28:54.1291232Z     gradcheck(
2024-12-18T00:28:54.1292028Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/testing/_internal/common_utils.py", line 4914, in gradcheck
2024-12-18T00:28:54.1293026Z     return torch.autograd.gradcheck(fn, inputs, **kwargs)
2024-12-18T00:28:54.1293955Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 2055, in gradcheck
2024-12-18T00:28:54.1294790Z     return _gradcheck_helper(**args)
2024-12-18T00:28:54.1295677Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 2084, in _gradcheck_helper
2024-12-18T00:28:54.1296556Z     _gradcheck_real_imag(
2024-12-18T00:28:54.1297416Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 1494, in _gradcheck_real_imag
2024-12-18T00:28:54.1298306Z     gradcheck_fn(
2024-12-18T00:28:54.1299097Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 1924, in _fast_gradcheck
2024-12-18T00:28:54.1300082Z     analytical_vJu = _get_analytical_vJu_backward_mode(
2024-12-18T00:28:54.1301067Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 807, in _get_analytical_vJu_backward_mode
2024-12-18T00:28:54.1302004Z     all_vJ = _check_analytical_jacobian_attributes(
2024-12-18T00:28:54.1302942Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 775, in _check_analytical_jacobian_attributes
2024-12-18T00:28:54.1303998Z     vjps1 = _get_analytical_vjps_wrt_specific_output(vjp_fn, output.clone(), v)
2024-12-18T00:28:54.1305064Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 909, in _get_analytical_vjps_wrt_specific_output
2024-12-18T00:28:54.1306022Z     grad_inputs = vjp_fn(v.reshape(sample_output.shape))
2024-12-18T00:28:54.1306833Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 769, in vjp_fn
2024-12-18T00:28:54.1307591Z     return torch.autograd.grad(
2024-12-18T00:28:54.1308286Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/__init__.py", line 496, in grad
2024-12-18T00:28:54.1309024Z     result = _engine_run_backward(
2024-12-18T00:28:54.1309800Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/graph.py", line 823, in _engine_run_backward
2024-12-18T00:28:54.1310846Z     return Variable._execution_engine.run_backward(  # Calls into the C++ engine to run the backward pass
2024-12-18T00:28:54.1312429Z RuntimeError: result2.storage().use_count() == 1 INTERNAL ASSERT FAILED at "/var/lib/jenkins/workspace/torch/csrc/autograd/generated/VariableType_3.cpp":11909, please report a bug to PyTorch. function: linear_backward
2024-12-18T00:28:54.1313606Z 
2024-12-18T00:28:54.1313859Z To execute this test, run the following from the base repo dir:
2024-12-18T00:28:54.1314631Z     python test/test_nestedtensor.py TestNestedTensorSubclassCUDA.test_linear_nt_dim_3_cuda
2024-12-18T00:28:54.1315178Z 
2024-12-18T00:28:54.1315483Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0
2024-12-18T00:28:54.1316238Z =================================== FAILURES ===================================
2024-12-18T00:28:54.1316889Z ____________ TestNestedTensorSubclassCUDA.test_linear_nt_dim_3_cuda ____________
2024-12-18T00:28:54.1317480Z Traceback (most recent call last):
2024-12-18T00:28:54.1318116Z   File "/var/lib/jenkins/workspace/test/test_nestedtensor.py", line 3790, in test_linear
2024-12-18T00:28:54.1318831Z     gradcheck(
2024-12-18T00:28:54.1319581Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/testing/_internal/common_utils.py", line 4914, in gradcheck
2024-12-18T00:28:54.1320485Z     return torch.autograd.gradcheck(fn, inputs, **kwargs)
2024-12-18T00:28:54.1321326Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 2055, in gradcheck
2024-12-18T00:28:54.1322081Z     return _gradcheck_helper(**args)
2024-12-18T00:28:54.1322882Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 2084, in _gradcheck_helper
2024-12-18T00:28:54.1323703Z     _gradcheck_real_imag(
2024-12-18T00:28:54.1324479Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 1494, in _gradcheck_real_imag
2024-12-18T00:28:54.1325291Z     gradcheck_fn(
2024-12-18T00:28:54.1326011Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 1924, in _fast_gradcheck
2024-12-18T00:28:54.1326857Z     analytical_vJu = _get_analytical_vJu_backward_mode(
2024-12-18T00:28:54.1327793Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 807, in _get_analytical_vJu_backward_mode
2024-12-18T00:28:54.1328711Z     all_vJ = _check_analytical_jacobian_attributes(
2024-12-18T00:28:54.1329642Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 775, in _check_analytical_jacobian_attributes
2024-12-18T00:28:54.1330685Z     vjps1 = _get_analytical_vjps_wrt_specific_output(vjp_fn, output.clone(), v)
2024-12-18T00:28:54.1331748Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 909, in _get_analytical_vjps_wrt_specific_output
2024-12-18T00:28:54.1332723Z     grad_inputs = vjp_fn(v.reshape(sample_output.shape))
2024-12-18T00:28:54.1333529Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 769, in vjp_fn
2024-12-18T00:28:54.1334280Z     return torch.autograd.grad(
2024-12-18T00:28:54.1335048Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/__init__.py", line 496, in grad
2024-12-18T00:28:54.1335845Z     result = _engine_run_backward(
2024-12-18T00:28:54.1336707Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/graph.py", line 823, in _engine_run_backward
2024-12-18T00:28:54.1337867Z     return Variable._execution_engine.run_backward(  # Calls into the C++ engine to run the backward pass
2024-12-18T00:28:54.1339605Z RuntimeError: result2.storage().use_count() == 1 INTERNAL ASSERT FAILED at "/var/lib/jenkins/workspace/torch/csrc/autograd/generated/VariableType_3.cpp":11909, please report a bug to PyTorch. function: linear_backward
2024-12-18T00:28:54.1340892Z 
2024-12-18T00:28:54.1360543Z To execute this test, run the following from the base repo dir:
2024-12-18T00:28:54.1361452Z     python test/test_nestedtensor.py TestNestedTensorSubclassCUDA.test_linear_nt_dim_3_cuda
2024-12-18T00:28:54.1362018Z 
2024-12-18T00:28:54.1362324Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0
2024-12-18T00:28:54.1363429Z - generated xml file: /var/lib/jenkins/workspace/test/test-reports/python-pytest/test_nestedtensor/test_nestedtensor-a57b624bf94dd066.xml -
2024-12-18T00:28:54.1364431Z =========================== short test summary info ============================
2024-12-18T00:28:54.1366279Z FAILED [0.0238s] test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_nt_dim_3_cuda - RuntimeError: result2.storage().use_count() == 1 INTERNAL ASSERT FAILED at "/var/lib/jenkins/workspace/torch/csrc/autograd/generated/VariableType_3.cpp":11909, please report a bug to PyTorch. function: linear_backward
2024-12-18T00:28:54.1368131Z 
2024-12-18T00:28:54.1368410Z To execute this test, run the following from the base repo dir:
2024-12-18T00:28:54.1369302Z     python test/test_nestedtensor.py TestNestedTensorSubclassCUDA.test_linear_nt_dim_3_cuda
2024-12-18T00:28:54.1369846Z 
2024-12-18T00:28:54.1370168Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0
2024-12-18T00:28:54.1370806Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!!
2024-12-18T00:28:54.1371412Z ============= 1 failed, 480 passed, 16 skipped, 2 rerun in 11.24s ==============
2024-12-18T00:28:54.1371928Z Got exit code 1
2024-12-18T00:28:54.1372271Z Retrying single test...
2024-12-18T00:28:54.1372991Z Test results will be stored in test-reports/python-pytest/test_nestedtensor/test_nestedtensor-e984fecf6c35c4f2.xml
2024-12-18T00:28:54.1373830Z ============================= test session starts ==============================
2024-12-18T00:28:54.1374529Z platform linux -- Python 3.10.15, pytest-7.3.2, pluggy-1.5.0 -- /opt/conda/envs/py_3.10/bin/python
2024-12-18T00:28:54.1375185Z cachedir: .pytest_cache
2024-12-18T00:28:54.1375955Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow]
2024-12-18T00:28:54.1376784Z rootdir: /var/lib/jenkins/workspace
2024-12-18T00:28:54.1377196Z configfile: pytest.ini
2024-12-18T00:28:54.1377964Z plugins: hypothesis-5.35.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, subtests-0.13.1, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0
2024-12-18T00:28:54.1378917Z collecting ... collected 1569 items / 1568 deselected / 1 selected
2024-12-18T00:28:54.1379933Z stepcurrent: skipping 496 already run items. Running only test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_nt_dim_3_cuda
2024-12-18T00:28:54.1380840Z Running 1 items in this shard
2024-12-18T00:28:54.1381096Z 
2024-12-18T00:28:54.1382033Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_nt_dim_3_cuda [W1218 00:28:44.440993548 Module.cpp:182] symbolizing C++ stack trace for exception; if this hangs, rerun with TORCH_DISABLE_ADDR2LINE=1...
2024-12-18T00:28:54.1383066Z 
2024-12-18T00:28:54.1383251Z ('RERUN', {'yellow': True}) [0.4141s] [100%]
2024-12-18T00:28:54.1384447Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_nt_dim_3_cuda [W1218 00:28:44.743375004 Module.cpp:182] symbolizing C++ stack trace for exception; if this hangs, rerun with TORCH_DISABLE_ADDR2LINE=1...
2024-12-18T00:28:54.1385482Z 
2024-12-18T00:28:54.1385664Z ('RERUN', {'yellow': True}) [0.0266s] [100%]
2024-12-18T00:28:54.1386836Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_nt_dim_3_cuda [W1218 00:28:44.769950104 Module.cpp:182] symbolizing C++ stack trace for exception; if this hangs, rerun with TORCH_DISABLE_ADDR2LINE=1...
2024-12-18T00:28:54.1387880Z 
2024-12-18T00:28:54.1388028Z FAILED [0.0244s] [100%]
2024-12-18T00:28:54.1388262Z 
2024-12-18T00:28:54.1388443Z ==================================== RERUNS ====================================
2024-12-18T00:28:54.1389090Z ____________ TestNestedTensorSubclassCUDA.test_linear_nt_dim_3_cuda ____________
2024-12-18T00:28:54.1389708Z Traceback (most recent call last):
2024-12-18T00:28:54.1390366Z   File "/var/lib/jenkins/workspace/test/test_nestedtensor.py", line 3790, in test_linear
2024-12-18T00:28:54.1390986Z     gradcheck(
2024-12-18T00:28:54.1391721Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/testing/_internal/common_utils.py", line 4914, in gradcheck
2024-12-18T00:28:54.1392630Z     return torch.autograd.gradcheck(fn, inputs, **kwargs)
2024-12-18T00:28:54.1393468Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 2055, in gradcheck
2024-12-18T00:28:54.1394237Z     return _gradcheck_helper(**args)
2024-12-18T00:28:54.1395038Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 2084, in _gradcheck_helper
2024-12-18T00:28:54.1395943Z     _gradcheck_real_imag(
2024-12-18T00:28:54.1396723Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 1494, in _gradcheck_real_imag
2024-12-18T00:28:54.1397535Z     gradcheck_fn(
2024-12-18T00:28:54.1398343Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 1924, in _fast_gradcheck
2024-12-18T00:28:54.1399242Z     analytical_vJu = _get_analytical_vJu_backward_mode(
2024-12-18T00:28:54.1400240Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 807, in _get_analytical_vJu_backward_mode
2024-12-18T00:28:54.1401148Z     all_vJ = _check_analytical_jacobian_attributes(
2024-12-18T00:28:54.1402085Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 775, in _check_analytical_jacobian_attributes
2024-12-18T00:28:54.1403149Z     vjps1 = _get_analytical_vjps_wrt_specific_output(vjp_fn, output.clone(), v)
2024-12-18T00:28:54.1404214Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 909, in _get_analytical_vjps_wrt_specific_output
2024-12-18T00:28:54.1405190Z     grad_inputs = vjp_fn(v.reshape(sample_output.shape))
2024-12-18T00:28:54.1406002Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 769, in vjp_fn
2024-12-18T00:28:54.1406762Z     return torch.autograd.grad(
2024-12-18T00:28:54.1407500Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/__init__.py", line 496, in grad
2024-12-18T00:28:54.1408327Z     result = _engine_run_backward(
2024-12-18T00:28:54.1409197Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/graph.py", line 823, in _engine_run_backward
2024-12-18T00:28:54.1410386Z     return Variable._execution_engine.run_backward(  # Calls into the C++ engine to run the backward pass
2024-12-18T00:28:54.1412132Z RuntimeError: result2.storage().use_count() == 1 INTERNAL ASSERT FAILED at "/var/lib/jenkins/workspace/torch/csrc/autograd/generated/VariableType_3.cpp":11909, please report a bug to PyTorch. function: linear_backward
2024-12-18T00:28:54.1414184Z Exception raised from linear_backward at /var/lib/jenkins/workspace/torch/csrc/autograd/generated/VariableType_3.cpp:11909 (most recent call first):
2024-12-18T00:28:54.1415241Z C++ CapturedTraceback:
2024-12-18T00:28:54.1416954Z #4 std::_Function_handler<std::shared_ptr<c10::LazyValue<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > const> (), c10::SetStackTraceFetcher(std::function<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > ()>)::{lambda()#1}>::_M_invoke(std::_Any_data const&) from Logging.cpp:0
2024-12-18T00:28:54.1419106Z #5 c10::Error::Error(c10::SourceLocation, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >) from ??:0
2024-12-18T00:28:54.1420529Z #6 c10::detail::torchCheckFail(char const*, char const*, unsigned int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) from ??:0
2024-12-18T00:28:54.1421936Z #7 c10::detail::torchInternalAssertFail(char const*, char const*, unsigned int, char const*, char const*) from ??:0
2024-12-18T00:28:54.1423505Z #8 torch::autograd::VariableType::(anonymous namespace)::linear_backward(c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from VariableType_3.cpp:0
2024-12-18T00:28:54.1427583Z #9 c10::impl::make_boxed_from_unboxed_functor<c10::impl::detail::WrapFunctionIntoFunctor_<c10::CompileTimeFunctionPointer<std::tuple<at::Tensor, at::Tensor, at::Tensor> (c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>), &torch::autograd::VariableType::(anonymous namespace)::linear_backward>, std::tuple<at::Tensor, at::Tensor, at::Tensor>, c10::guts::typelist::typelist<c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul> > >, false>::call(c10::OperatorKernel*, c10::OperatorHandle const&, c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) from VariableType_3.cpp:0
2024-12-18T00:28:54.1431610Z #10 c10::OperatorHandle::redispatchBoxed(c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) const from :0
2024-12-18T00:28:54.1433602Z #11 void c10::BoxedKernel::make_boxed_function<&(anonymous namespace)::pythonTLSSnapshotFallback>(c10::OperatorKernel*, c10::OperatorHandle const&, c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) from PythonFallbackKernel.cpp:0
2024-12-18T00:28:54.1436416Z #12 c10::impl::BoxedKernelWrapper<std::tuple<at::Tensor, at::Tensor, at::Tensor> (at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>), void>::call(c10::BoxedKernel const&, c10::OperatorHandle const&, c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from :0
2024-12-18T00:28:54.1438475Z #13 at::_ops::linear_backward::call(at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from ??:0
2024-12-18T00:28:54.1439661Z #14 torch::autograd::generated::LinearBackward0::apply(std::vector<at::Tensor, std::allocator<at::Tensor> >&&) from ??:0
2024-12-18T00:28:54.1440752Z #15 torch::autograd::Node::operator()(std::vector<at::Tensor, std::allocator<at::Tensor> >&&) from :0
2024-12-18T00:28:54.1442262Z #16 torch::autograd::Engine::evaluate_function(std::shared_ptr<torch::autograd::GraphTask>&, torch::autograd::Node*, torch::autograd::InputBuffer&, std::shared_ptr<torch::autograd::ReadyQueue> const&) from ??:0
2024-12-18T00:28:54.1443781Z #17 torch::autograd::Engine::thread_main(std::shared_ptr<torch::autograd::GraphTask> const&) from ??:0
2024-12-18T00:28:54.1444867Z #18 torch::autograd::Engine::thread_init(int, std::shared_ptr<torch::autograd::ReadyQueue> const&, bool) from ??:0
2024-12-18T00:28:54.1446082Z #19 torch::autograd::python::PythonEngine::thread_init(int, std::shared_ptr<torch::autograd::ReadyQueue> const&, bool) from ??:0
2024-12-18T00:28:54.1447006Z #20 execute_native_thread_routine from thread.cc:0
2024-12-18T00:28:54.1447693Z #21 start_thread from /build/glibc-LcI20x/glibc-2.31/nptl/pthread_create.c:477
2024-12-18T00:28:54.1448318Z #22 clone from ??:0
2024-12-18T00:28:54.1448535Z 
2024-12-18T00:28:54.1448552Z 
2024-12-18T00:28:54.1448844Z To execute this test, run the following from the base repo dir:
2024-12-18T00:28:54.1449678Z     python test/test_nestedtensor.py TestNestedTensorSubclassCUDA.test_linear_nt_dim_3_cuda
2024-12-18T00:28:54.1450258Z 
2024-12-18T00:28:54.1450602Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0
2024-12-18T00:28:54.1451341Z ----------------------------- Captured stderr call -----------------------------
2024-12-18T00:28:54.1453321Z /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nested/_internal/ops.py:576: UserWarning: Attempting to run cuBLAS, but there was no current CUDA context! Attempting to set the primary context... (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/cuda/CublasHandlePool.cpp:180.)
2024-12-18T00:28:54.1455335Z   torch.matmul(grad_output._values, weight), **extract_kwargs(grad_output)
2024-12-18T00:28:54.1456471Z ____________ TestNestedTensorSubclassCUDA.test_linear_nt_dim_3_cuda ____________
2024-12-18T00:28:54.1457140Z Traceback (most recent call last):
2024-12-18T00:28:54.1457783Z   File "/var/lib/jenkins/workspace/test/test_nestedtensor.py", line 3790, in test_linear
2024-12-18T00:28:54.1458420Z     gradcheck(
2024-12-18T00:28:54.1459164Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/testing/_internal/common_utils.py", line 4914, in gradcheck
2024-12-18T00:28:54.1460072Z     return torch.autograd.gradcheck(fn, inputs, **kwargs)
2024-12-18T00:28:54.1460906Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 2055, in gradcheck
2024-12-18T00:28:54.1461826Z     return _gradcheck_helper(**args)
2024-12-18T00:28:54.1462625Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 2084, in _gradcheck_helper
2024-12-18T00:28:54.1463429Z     _gradcheck_real_imag(
2024-12-18T00:28:54.1464329Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 1494, in _gradcheck_real_imag
2024-12-18T00:28:54.1465159Z     gradcheck_fn(
2024-12-18T00:28:54.1465868Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 1924, in _fast_gradcheck
2024-12-18T00:28:54.1466709Z     analytical_vJu = _get_analytical_vJu_backward_mode(
2024-12-18T00:28:54.1467645Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 807, in _get_analytical_vJu_backward_mode
2024-12-18T00:28:54.1468571Z     all_vJ = _check_analytical_jacobian_attributes(
2024-12-18T00:28:54.1469510Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 775, in _check_analytical_jacobian_attributes
2024-12-18T00:28:54.1470570Z     vjps1 = _get_analytical_vjps_wrt_specific_output(vjp_fn, output.clone(), v)
2024-12-18T00:28:54.1471640Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 909, in _get_analytical_vjps_wrt_specific_output
2024-12-18T00:28:54.1472601Z     grad_inputs = vjp_fn(v.reshape(sample_output.shape))
2024-12-18T00:28:54.1473414Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 769, in vjp_fn
2024-12-18T00:28:54.1474168Z     return torch.autograd.grad(
2024-12-18T00:28:54.1474928Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/__init__.py", line 496, in grad
2024-12-18T00:28:54.1475730Z     result = _engine_run_backward(
2024-12-18T00:28:54.1476591Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/graph.py", line 823, in _engine_run_backward
2024-12-18T00:28:54.1477765Z     return Variable._execution_engine.run_backward(  # Calls into the C++ engine to run the backward pass
2024-12-18T00:28:54.1479507Z RuntimeError: result2.storage().use_count() == 1 INTERNAL ASSERT FAILED at "/var/lib/jenkins/workspace/torch/csrc/autograd/generated/VariableType_3.cpp":11909, please report a bug to PyTorch. function: linear_backward
2024-12-18T00:28:54.1481559Z Exception raised from linear_backward at /var/lib/jenkins/workspace/torch/csrc/autograd/generated/VariableType_3.cpp:11909 (most recent call first):
2024-12-18T00:28:54.1482629Z C++ CapturedTraceback:
2024-12-18T00:28:54.1484326Z #4 std::_Function_handler<std::shared_ptr<c10::LazyValue<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > const> (), c10::SetStackTraceFetcher(std::function<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > ()>)::{lambda()#1}>::_M_invoke(std::_Any_data const&) from Logging.cpp:0
2024-12-18T00:28:54.1486487Z #5 c10::Error::Error(c10::SourceLocation, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >) from ??:0
2024-12-18T00:28:54.1487923Z #6 c10::detail::torchCheckFail(char const*, char const*, unsigned int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) from ??:0
2024-12-18T00:28:54.1489323Z #7 c10::detail::torchInternalAssertFail(char const*, char const*, unsigned int, char const*, char const*) from ??:0
2024-12-18T00:28:54.1490920Z #8 torch::autograd::VariableType::(anonymous namespace)::linear_backward(c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from VariableType_3.cpp:0
2024-12-18T00:28:54.1495099Z #9 c10::impl::make_boxed_from_unboxed_functor<c10::impl::detail::WrapFunctionIntoFunctor_<c10::CompileTimeFunctionPointer<std::tuple<at::Tensor, at::Tensor, at::Tensor> (c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>), &torch::autograd::VariableType::(anonymous namespace)::linear_backward>, std::tuple<at::Tensor, at::Tensor, at::Tensor>, c10::guts::typelist::typelist<c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul> > >, false>::call(c10::OperatorKernel*, c10::OperatorHandle const&, c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) from VariableType_3.cpp:0
2024-12-18T00:28:54.1498992Z #10 c10::OperatorHandle::redispatchBoxed(c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) const from :0
2024-12-18T00:28:54.1500980Z #11 void c10::BoxedKernel::make_boxed_function<&(anonymous namespace)::pythonTLSSnapshotFallback>(c10::OperatorKernel*, c10::OperatorHandle const&, c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) from PythonFallbackKernel.cpp:0
2024-12-18T00:28:54.1503516Z #12 c10::impl::BoxedKernelWrapper<std::tuple<at::Tensor, at::Tensor, at::Tensor> (at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>), void>::call(c10::BoxedKernel const&, c10::OperatorHandle const&, c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from :0
2024-12-18T00:28:54.1505383Z #13 at::_ops::linear_backward::call(at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from ??:0
2024-12-18T00:28:54.1506434Z #14 torch::autograd::generated::LinearBackward0::apply(std::vector<at::Tensor, std::allocator<at::Tensor> >&&) from ??:0
2024-12-18T00:28:54.1507424Z #15 torch::autograd::Node::operator()(std::vector<at::Tensor, std::allocator<at::Tensor> >&&) from :0
2024-12-18T00:28:54.1508792Z #16 torch::autograd::Engine::evaluate_function(std::shared_ptr<torch::autograd::GraphTask>&, torch::autograd::Node*, torch::autograd::InputBuffer&, std::shared_ptr<torch::autograd::ReadyQueue> const&) from ??:0
2024-12-18T00:28:54.1510172Z #17 torch::autograd::Engine::thread_main(std::shared_ptr<torch::autograd::GraphTask> const&) from ??:0
2024-12-18T00:28:54.1511147Z #18 torch::autograd::Engine::thread_init(int, std::shared_ptr<torch::autograd::ReadyQueue> const&, bool) from ??:0
2024-12-18T00:28:54.1512236Z #19 torch::autograd::python::PythonEngine::thread_init(int, std::shared_ptr<torch::autograd::ReadyQueue> const&, bool) from ??:0
2024-12-18T00:28:54.1513076Z #20 execute_native_thread_routine from thread.cc:0
2024-12-18T00:28:54.1513702Z #21 start_thread from /build/glibc-LcI20x/glibc-2.31/nptl/pthread_create.c:477
2024-12-18T00:28:54.1514285Z #22 clone from ??:0
2024-12-18T00:28:54.1514502Z 
2024-12-18T00:28:54.1514520Z 
2024-12-18T00:28:54.1514771Z To execute this test, run the following from the base repo dir:
2024-12-18T00:28:54.1515534Z     python test/test_nestedtensor.py TestNestedTensorSubclassCUDA.test_linear_nt_dim_3_cuda
2024-12-18T00:28:54.1516059Z 
2024-12-18T00:28:54.1516376Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0
2024-12-18T00:28:54.1517067Z ----------------------------- Captured stderr call -----------------------------
2024-12-18T00:28:54.1518843Z /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nested/_internal/ops.py:576: UserWarning: Attempting to run cuBLAS, but there was no current CUDA context! Attempting to set the primary context... (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/cuda/CublasHandlePool.cpp:180.)
2024-12-18T00:28:54.1520636Z   torch.matmul(grad_output._values, weight), **extract_kwargs(grad_output)
2024-12-18T00:28:54.1521233Z =================================== FAILURES ===================================
2024-12-18T00:28:54.1521879Z ____________ TestNestedTensorSubclassCUDA.test_linear_nt_dim_3_cuda ____________
2024-12-18T00:28:54.1522491Z Traceback (most recent call last):
2024-12-18T00:28:54.1523128Z   File "/var/lib/jenkins/workspace/test/test_nestedtensor.py", line 3790, in test_linear
2024-12-18T00:28:54.1523765Z     gradcheck(
2024-12-18T00:28:54.1524481Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/testing/_internal/common_utils.py", line 4914, in gradcheck
2024-12-18T00:28:54.1525502Z     return torch.autograd.gradcheck(fn, inputs, **kwargs)
2024-12-18T00:28:54.1526343Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 2055, in gradcheck
2024-12-18T00:28:54.1527116Z     return _gradcheck_helper(**args)
2024-12-18T00:28:54.1527998Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 2084, in _gradcheck_helper
2024-12-18T00:28:54.1528822Z     _gradcheck_real_imag(
2024-12-18T00:28:54.1529584Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 1494, in _gradcheck_real_imag
2024-12-18T00:28:54.1530395Z     gradcheck_fn(
2024-12-18T00:28:54.1531106Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 1924, in _fast_gradcheck
2024-12-18T00:28:54.1531968Z     analytical_vJu = _get_analytical_vJu_backward_mode(
2024-12-18T00:28:54.1532900Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 807, in _get_analytical_vJu_backward_mode
2024-12-18T00:28:54.1533832Z     all_vJ = _check_analytical_jacobian_attributes(
2024-12-18T00:28:54.1534752Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 775, in _check_analytical_jacobian_attributes
2024-12-18T00:28:54.1535809Z     vjps1 = _get_analytical_vjps_wrt_specific_output(vjp_fn, output.clone(), v)
2024-12-18T00:28:54.1536877Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 909, in _get_analytical_vjps_wrt_specific_output
2024-12-18T00:28:54.1537845Z     grad_inputs = vjp_fn(v.reshape(sample_output.shape))
2024-12-18T00:28:54.1538652Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 769, in vjp_fn
2024-12-18T00:28:54.1539404Z     return torch.autograd.grad(
2024-12-18T00:28:54.1540143Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/__init__.py", line 496, in grad
2024-12-18T00:28:54.1540960Z     result = _engine_run_backward(
2024-12-18T00:28:54.1541823Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/graph.py", line 823, in _engine_run_backward
2024-12-18T00:28:54.1543012Z     return Variable._execution_engine.run_backward(  # Calls into the C++ engine to run the backward pass
2024-12-18T00:28:54.1544739Z RuntimeError: result2.storage().use_count() == 1 INTERNAL ASSERT FAILED at "/var/lib/jenkins/workspace/torch/csrc/autograd/generated/VariableType_3.cpp":11909, please report a bug to PyTorch. function: linear_backward
2024-12-18T00:28:54.1546785Z Exception raised from linear_backward at /var/lib/jenkins/workspace/torch/csrc/autograd/generated/VariableType_3.cpp:11909 (most recent call first):
2024-12-18T00:28:54.1547861Z C++ CapturedTraceback:
2024-12-18T00:28:54.1549524Z #4 std::_Function_handler<std::shared_ptr<c10::LazyValue<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > const> (), c10::SetStackTraceFetcher(std::function<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > ()>)::{lambda()#1}>::_M_invoke(std::_Any_data const&) from Logging.cpp:0
2024-12-18T00:28:54.1551692Z #5 c10::Error::Error(c10::SourceLocation, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >) from ??:0
2024-12-18T00:28:54.1553133Z #6 c10::detail::torchCheckFail(char const*, char const*, unsigned int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) from ??:0
2024-12-18T00:28:54.1554516Z #7 c10::detail::torchInternalAssertFail(char const*, char const*, unsigned int, char const*, char const*) from ??:0
2024-12-18T00:28:54.1556261Z #8 torch::autograd::VariableType::(anonymous namespace)::linear_backward(c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from VariableType_3.cpp:0
2024-12-18T00:28:54.1560193Z #9 c10::impl::make_boxed_from_unboxed_functor<c10::impl::detail::WrapFunctionIntoFunctor_<c10::CompileTimeFunctionPointer<std::tuple<at::Tensor, at::Tensor, at::Tensor> (c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>), &torch::autograd::VariableType::(anonymous namespace)::linear_backward>, std::tuple<at::Tensor, at::Tensor, at::Tensor>, c10::guts::typelist::typelist<c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul> > >, false>::call(c10::OperatorKernel*, c10::OperatorHandle const&, c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) from VariableType_3.cpp:0
2024-12-18T00:28:54.1563724Z #10 c10::OperatorHandle::redispatchBoxed(c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) const from :0
2024-12-18T00:28:54.1565513Z #11 void c10::BoxedKernel::make_boxed_function<&(anonymous namespace)::pythonTLSSnapshotFallback>(c10::OperatorKernel*, c10::OperatorHandle const&, c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) from PythonFallbackKernel.cpp:0
2024-12-18T00:28:54.1568030Z #12 c10::impl::BoxedKernelWrapper<std::tuple<at::Tensor, at::Tensor, at::Tensor> (at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>), void>::call(c10::BoxedKernel const&, c10::OperatorHandle const&, c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from :0
2024-12-18T00:28:54.1569865Z #13 at::_ops::linear_backward::call(at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from ??:0
2024-12-18T00:28:54.1570928Z #14 torch::autograd::generated::LinearBackward0::apply(std::vector<at::Tensor, std::allocator<at::Tensor> >&&) from ??:0
2024-12-18T00:28:54.1571924Z #15 torch::autograd::Node::operator()(std::vector<at::Tensor, std::allocator<at::Tensor> >&&) from :0
2024-12-18T00:28:54.1573278Z #16 torch::autograd::Engine::evaluate_function(std::shared_ptr<torch::autograd::GraphTask>&, torch::autograd::Node*, torch::autograd::InputBuffer&, std::shared_ptr<torch::autograd::ReadyQueue> const&) from ??:0
2024-12-18T00:28:54.1574660Z #17 torch::autograd::Engine::thread_main(std::shared_ptr<torch::autograd::GraphTask> const&) from ??:0
2024-12-18T00:28:54.1575609Z #18 torch::autograd::Engine::thread_init(int, std::shared_ptr<torch::autograd::ReadyQueue> const&, bool) from ??:0
2024-12-18T00:28:54.1576701Z #19 torch::autograd::python::PythonEngine::thread_init(int, std::shared_ptr<torch::autograd::ReadyQueue> const&, bool) from ??:0
2024-12-18T00:28:54.1577546Z #20 execute_native_thread_routine from thread.cc:0
2024-12-18T00:28:54.1578187Z #21 start_thread from /build/glibc-LcI20x/glibc-2.31/nptl/pthread_create.c:477
2024-12-18T00:28:54.1578764Z #22 clone from ??:0
2024-12-18T00:28:54.1578966Z 
2024-12-18T00:28:54.1578984Z 
2024-12-18T00:28:54.1579254Z To execute this test, run the following from the base repo dir:
2024-12-18T00:28:54.1580006Z     python test/test_nestedtensor.py TestNestedTensorSubclassCUDA.test_linear_nt_dim_3_cuda
2024-12-18T00:28:54.1580559Z 
2024-12-18T00:28:54.1580859Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0
2024-12-18T00:28:54.1581547Z ----------------------------- Captured stderr call -----------------------------
2024-12-18T00:28:54.1583317Z /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nested/_internal/ops.py:576: UserWarning: Attempting to run cuBLAS, but there was no current CUDA context! Attempting to set the primary context... (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/cuda/CublasHandlePool.cpp:180.)
2024-12-18T00:28:54.1585108Z   torch.matmul(grad_output._values, weight), **extract_kwargs(grad_output)
2024-12-18T00:28:54.1586225Z - generated xml file: /var/lib/jenkins/workspace/test/test-reports/python-pytest/test_nestedtensor/test_nestedtensor-e984fecf6c35c4f2.xml -
2024-12-18T00:28:54.1587232Z =========================== short test summary info ============================
2024-12-18T00:28:54.1589179Z FAILED [0.0244s] test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_nt_dim_3_cuda - RuntimeError: result2.storage().use_count() == 1 INTERNAL ASSERT FAILED at "/var/lib/jenkins/workspace/torch/csrc/autograd/generated/VariableType_3.cpp":11909, please report a bug to PyTorch. function: linear_backward
2024-12-18T00:28:54.1591549Z Exception raised from linear_backward at /var/lib/jenkins/workspace/torch/csrc/autograd/generated/VariableType_3.cpp:11909 (most recent call first):
2024-12-18T00:28:54.1592542Z C++ CapturedTraceback:
2024-12-18T00:28:54.1594225Z #4 std::_Function_handler<std::shared_ptr<c10::LazyValue<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > const> (), c10::SetStackTraceFetcher(std::function<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > ()>)::{lambda()#1}>::_M_invoke(std::_Any_data const&) from Logging.cpp:0
2024-12-18T00:28:54.1596390Z #5 c10::Error::Error(c10::SourceLocation, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >) from ??:0
2024-12-18T00:28:54.1597827Z #6 c10::detail::torchCheckFail(char const*, char const*, unsigned int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) from ??:0
2024-12-18T00:28:54.1599220Z #7 c10::detail::torchInternalAssertFail(char const*, char const*, unsigned int, char const*, char const*) from ??:0
2024-12-18T00:28:54.1600800Z #8 torch::autograd::VariableType::(anonymous namespace)::linear_backward(c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from VariableType_3.cpp:0
2024-12-18T00:28:54.1604502Z #9 c10::impl::make_boxed_from_unboxed_functor<c10::impl::detail::WrapFunctionIntoFunctor_<c10::CompileTimeFunctionPointer<std::tuple<at::Tensor, at::Tensor, at::Tensor> (c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>), &torch::autograd::VariableType::(anonymous namespace)::linear_backward>, std::tuple<at::Tensor, at::Tensor, at::Tensor>, c10::guts::typelist::typelist<c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul> > >, false>::call(c10::OperatorKernel*, c10::OperatorHandle const&, c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) from VariableType_3.cpp:0
2024-12-18T00:28:54.1607924Z #10 c10::OperatorHandle::redispatchBoxed(c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) const from :0
2024-12-18T00:28:54.1609714Z #11 void c10::BoxedKernel::make_boxed_function<&(anonymous namespace)::pythonTLSSnapshotFallback>(c10::OperatorKernel*, c10::OperatorHandle const&, c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) from PythonFallbackKernel.cpp:0
2024-12-18T00:28:54.1612241Z #12 c10::impl::BoxedKernelWrapper<std::tuple<at::Tensor, at::Tensor, at::Tensor> (at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>), void>::call(c10::BoxedKernel const&, c10::OperatorHandle const&, c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from :0
2024-12-18T00:28:54.1614083Z #13 at::_ops::linear_backward::call(at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from ??:0
2024-12-18T00:28:54.1615156Z #14 torch::autograd::generated::LinearBackward0::apply(std::vector<at::Tensor, std::allocator<at::Tensor> >&&) from ??:0
2024-12-18T00:28:54.1616150Z #15 torch::autograd::Node::operator()(std::vector<at::Tensor, std::allocator<at::Tensor> >&&) from :0
2024-12-18T00:28:54.1617519Z #16 torch::autograd::Engine::evaluate_function(std::shared_ptr<torch::autograd::GraphTask>&, torch::autograd::Node*, torch::autograd::InputBuffer&, std::shared_ptr<torch::autograd::ReadyQueue> const&) from ??:0
2024-12-18T00:28:54.1618874Z #17 torch::autograd::Engine::thread_main(std::shared_ptr<torch::autograd::GraphTask> const&) from ??:0
2024-12-18T00:28:54.1619844Z #18 torch::autograd::Engine::thread_init(int, std::shared_ptr<torch::autograd::ReadyQueue> const&, bool) from ??:0
2024-12-18T00:28:54.1621045Z #19 torch::autograd::python::PythonEngine::thread_init(int, std::shared_ptr<torch::autograd::ReadyQueue> const&, bool) from ??:0
2024-12-18T00:28:54.1621886Z #20 execute_native_thread_routine from thread.cc:0
2024-12-18T00:28:54.1622524Z #21 start_thread from /build/glibc-LcI20x/glibc-2.31/nptl/pthread_create.c:477
2024-12-18T00:28:54.1623183Z #22 clone from ??:0
2024-12-18T00:28:54.1623401Z 
2024-12-18T00:28:54.1623418Z 
2024-12-18T00:28:54.1623669Z To execute this test, run the following from the base repo dir:
2024-12-18T00:28:54.1624438Z     python test/test_nestedtensor.py TestNestedTensorSubclassCUDA.test_linear_nt_dim_3_cuda
2024-12-18T00:28:54.1624984Z 
2024-12-18T00:28:54.1625289Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0
2024-12-18T00:28:54.1625937Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!!
2024-12-18T00:28:54.1626524Z ================= 1 failed, 1568 deselected, 2 rerun in 0.62s ==================
2024-12-18T00:28:54.1627047Z Got exit code 1
2024-12-18T00:28:54.1627364Z Retrying single test...
2024-12-18T00:28:54.1628082Z Test results will be stored in test-reports/python-pytest/test_nestedtensor/test_nestedtensor-6205aa993cdfe70a.xml
2024-12-18T00:28:54.1628934Z ============================= test session starts ==============================
2024-12-18T00:28:54.1629653Z platform linux -- Python 3.10.15, pytest-7.3.2, pluggy-1.5.0 -- /opt/conda/envs/py_3.10/bin/python
2024-12-18T00:28:54.1630301Z cachedir: .pytest_cache
2024-12-18T00:28:54.1631063Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow]
2024-12-18T00:28:54.1631888Z rootdir: /var/lib/jenkins/workspace
2024-12-18T00:28:54.1632301Z configfile: pytest.ini
2024-12-18T00:28:54.1633063Z plugins: hypothesis-5.35.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, subtests-0.13.1, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0
2024-12-18T00:28:54.1634027Z collecting ... collected 1569 items / 1568 deselected / 1 selected
2024-12-18T00:28:54.1635037Z stepcurrent: skipping 496 already run items. Running only test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_nt_dim_3_cuda
2024-12-18T00:28:54.1635927Z Running 1 items in this shard
2024-12-18T00:28:54.1636174Z 
2024-12-18T00:28:54.1637117Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_nt_dim_3_cuda [W1218 00:28:52.443468406 Module.cpp:182] symbolizing C++ stack trace for exception; if this hangs, rerun with TORCH_DISABLE_ADDR2LINE=1...
2024-12-18T00:28:54.1638155Z 
2024-12-18T00:28:54.1638341Z ('RERUN', {'yellow': True}) [0.4062s] [100%]
2024-12-18T00:28:54.1639530Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_nt_dim_3_cuda [W1218 00:28:52.746849094 Module.cpp:182] symbolizing C++ stack trace for exception; if this hangs, rerun with TORCH_DISABLE_ADDR2LINE=1...
2024-12-18T00:28:54.1640559Z 
2024-12-18T00:28:54.1640743Z ('RERUN', {'yellow': True}) [0.0280s] [100%]
2024-12-18T00:28:54.1641925Z test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_nt_dim_3_cuda [W1218 00:28:52.774965143 Module.cpp:182] symbolizing C++ stack trace for exception; if this hangs, rerun with TORCH_DISABLE_ADDR2LINE=1...
2024-12-18T00:28:54.1642994Z 
2024-12-18T00:28:54.1643135Z FAILED [0.0257s] [100%]
2024-12-18T00:28:54.1643369Z 
2024-12-18T00:28:54.1643556Z ==================================== RERUNS ====================================
2024-12-18T00:28:54.1644207Z ____________ TestNestedTensorSubclassCUDA.test_linear_nt_dim_3_cuda ____________
2024-12-18T00:28:54.1644828Z Traceback (most recent call last):
2024-12-18T00:28:54.1645471Z   File "/var/lib/jenkins/workspace/test/test_nestedtensor.py", line 3790, in test_linear
2024-12-18T00:28:54.1646086Z     gradcheck(
2024-12-18T00:28:54.1646942Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/testing/_internal/common_utils.py", line 4914, in gradcheck
2024-12-18T00:28:54.1648257Z     return torch.autograd.gradcheck(fn, inputs, **kwargs)
2024-12-18T00:28:54.1649099Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 2055, in gradcheck
2024-12-18T00:28:54.1649868Z     return _gradcheck_helper(**args)
2024-12-18T00:28:54.1650763Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 2084, in _gradcheck_helper
2024-12-18T00:28:54.1651565Z     _gradcheck_real_imag(
2024-12-18T00:28:54.1652342Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 1494, in _gradcheck_real_imag
2024-12-18T00:28:54.1653152Z     gradcheck_fn(
2024-12-18T00:28:54.1653861Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 1924, in _fast_gradcheck
2024-12-18T00:28:54.1654715Z     analytical_vJu = _get_analytical_vJu_backward_mode(
2024-12-18T00:28:54.1655648Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 807, in _get_analytical_vJu_backward_mode
2024-12-18T00:28:54.1657064Z     all_vJ = _check_analytical_jacobian_attributes(
2024-12-18T00:28:54.1658004Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 775, in _check_analytical_jacobian_attributes
2024-12-18T00:28:54.1659060Z     vjps1 = _get_analytical_vjps_wrt_specific_output(vjp_fn, output.clone(), v)
2024-12-18T00:28:54.1660123Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 909, in _get_analytical_vjps_wrt_specific_output
2024-12-18T00:28:54.1661097Z     grad_inputs = vjp_fn(v.reshape(sample_output.shape))
2024-12-18T00:28:54.1661900Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 769, in vjp_fn
2024-12-18T00:28:54.1662657Z     return torch.autograd.grad(
2024-12-18T00:28:54.1663413Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/__init__.py", line 496, in grad
2024-12-18T00:28:54.1664226Z     result = _engine_run_backward(
2024-12-18T00:28:54.1665096Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/graph.py", line 823, in _engine_run_backward
2024-12-18T00:28:54.1666269Z     return Variable._execution_engine.run_backward(  # Calls into the C++ engine to run the backward pass
2024-12-18T00:28:54.1668005Z RuntimeError: result2.storage().use_count() == 1 INTERNAL ASSERT FAILED at "/var/lib/jenkins/workspace/torch/csrc/autograd/generated/VariableType_3.cpp":11909, please report a bug to PyTorch. function: linear_backward
2024-12-18T00:28:54.1670034Z Exception raised from linear_backward at /var/lib/jenkins/workspace/torch/csrc/autograd/generated/VariableType_3.cpp:11909 (most recent call first):
2024-12-18T00:28:54.1671098Z C++ CapturedTraceback:
2024-12-18T00:28:54.1672782Z #4 std::_Function_handler<std::shared_ptr<c10::LazyValue<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > const> (), c10::SetStackTraceFetcher(std::function<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > ()>)::{lambda()#1}>::_M_invoke(std::_Any_data const&) from Logging.cpp:0
2024-12-18T00:28:54.1674932Z #5 c10::Error::Error(c10::SourceLocation, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >) from ??:0
2024-12-18T00:28:54.1676360Z #6 c10::detail::torchCheckFail(char const*, char const*, unsigned int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) from ??:0
2024-12-18T00:28:54.1677748Z #7 c10::detail::torchInternalAssertFail(char const*, char const*, unsigned int, char const*, char const*) from ??:0
2024-12-18T00:28:54.1679312Z #8 torch::autograd::VariableType::(anonymous namespace)::linear_backward(c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from VariableType_3.cpp:0
2024-12-18T00:28:54.1683584Z #9 c10::impl::make_boxed_from_unboxed_functor<c10::impl::detail::WrapFunctionIntoFunctor_<c10::CompileTimeFunctionPointer<std::tuple<at::Tensor, at::Tensor, at::Tensor> (c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>), &torch::autograd::VariableType::(anonymous namespace)::linear_backward>, std::tuple<at::Tensor, at::Tensor, at::Tensor>, c10::guts::typelist::typelist<c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul> > >, false>::call(c10::OperatorKernel*, c10::OperatorHandle const&, c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) from VariableType_3.cpp:0
2024-12-18T00:28:54.1687464Z #10 c10::OperatorHandle::redispatchBoxed(c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) const from :0
2024-12-18T00:28:54.1689425Z #11 void c10::BoxedKernel::make_boxed_function<&(anonymous namespace)::pythonTLSSnapshotFallback>(c10::OperatorKernel*, c10::OperatorHandle const&, c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) from PythonFallbackKernel.cpp:0
2024-12-18T00:28:54.1692223Z #12 c10::impl::BoxedKernelWrapper<std::tuple<at::Tensor, at::Tensor, at::Tensor> (at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>), void>::call(c10::BoxedKernel const&, c10::OperatorHandle const&, c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from :0
2024-12-18T00:28:54.1694276Z #13 at::_ops::linear_backward::call(at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from ??:0
2024-12-18T00:28:54.1695469Z #14 torch::autograd::generated::LinearBackward0::apply(std::vector<at::Tensor, std::allocator<at::Tensor> >&&) from ??:0
2024-12-18T00:28:54.1696555Z #15 torch::autograd::Node::operator()(std::vector<at::Tensor, std::allocator<at::Tensor> >&&) from :0
2024-12-18T00:28:54.1698057Z #16 torch::autograd::Engine::evaluate_function(std::shared_ptr<torch::autograd::GraphTask>&, torch::autograd::Node*, torch::autograd::InputBuffer&, std::shared_ptr<torch::autograd::ReadyQueue> const&) from ??:0
2024-12-18T00:28:54.1699559Z #17 torch::autograd::Engine::thread_main(std::shared_ptr<torch::autograd::GraphTask> const&) from ??:0
2024-12-18T00:28:54.1700677Z #18 torch::autograd::Engine::thread_init(int, std::shared_ptr<torch::autograd::ReadyQueue> const&, bool) from ??:0
2024-12-18T00:28:54.1701785Z #19 torch::autograd::python::PythonEngine::thread_init(int, std::shared_ptr<torch::autograd::ReadyQueue> const&, bool) from ??:0
2024-12-18T00:28:54.1702628Z #20 execute_native_thread_routine from thread.cc:0
2024-12-18T00:28:54.1703264Z #21 start_thread from /build/glibc-LcI20x/glibc-2.31/nptl/pthread_create.c:477
2024-12-18T00:28:54.1703836Z #22 clone from ??:0
2024-12-18T00:28:54.1704035Z 
2024-12-18T00:28:54.1704052Z 
2024-12-18T00:28:54.1704321Z To execute this test, run the following from the base repo dir:
2024-12-18T00:28:54.1705071Z     python test/test_nestedtensor.py TestNestedTensorSubclassCUDA.test_linear_nt_dim_3_cuda
2024-12-18T00:28:54.1705616Z 
2024-12-18T00:28:54.1705924Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0
2024-12-18T00:28:54.1706608Z ----------------------------- Captured stderr call -----------------------------
2024-12-18T00:28:54.1708382Z /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nested/_internal/ops.py:576: UserWarning: Attempting to run cuBLAS, but there was no current CUDA context! Attempting to set the primary context... (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/cuda/CublasHandlePool.cpp:180.)
2024-12-18T00:28:54.1710172Z   torch.matmul(grad_output._values, weight), **extract_kwargs(grad_output)
2024-12-18T00:28:54.1710928Z ____________ TestNestedTensorSubclassCUDA.test_linear_nt_dim_3_cuda ____________
2024-12-18T00:28:54.1711543Z Traceback (most recent call last):
2024-12-18T00:28:54.1712162Z   File "/var/lib/jenkins/workspace/test/test_nestedtensor.py", line 3790, in test_linear
2024-12-18T00:28:54.1712799Z     gradcheck(
2024-12-18T00:28:54.1713539Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/testing/_internal/common_utils.py", line 4914, in gradcheck
2024-12-18T00:28:54.1714577Z     return torch.autograd.gradcheck(fn, inputs, **kwargs)
2024-12-18T00:28:54.1715415Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 2055, in gradcheck
2024-12-18T00:28:54.1716268Z     return _gradcheck_helper(**args)
2024-12-18T00:28:54.1717072Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 2084, in _gradcheck_helper
2024-12-18T00:28:54.1717878Z     _gradcheck_real_imag(
2024-12-18T00:28:54.1718663Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 1494, in _gradcheck_real_imag
2024-12-18T00:28:54.1719467Z     gradcheck_fn(
2024-12-18T00:28:54.1720185Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 1924, in _fast_gradcheck
2024-12-18T00:28:54.1721024Z     analytical_vJu = _get_analytical_vJu_backward_mode(
2024-12-18T00:28:54.1721965Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 807, in _get_analytical_vJu_backward_mode
2024-12-18T00:28:54.1722888Z     all_vJ = _check_analytical_jacobian_attributes(
2024-12-18T00:28:54.1723822Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 775, in _check_analytical_jacobian_attributes
2024-12-18T00:28:54.1724864Z     vjps1 = _get_analytical_vjps_wrt_specific_output(vjp_fn, output.clone(), v)
2024-12-18T00:28:54.1725925Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 909, in _get_analytical_vjps_wrt_specific_output
2024-12-18T00:28:54.1726900Z     grad_inputs = vjp_fn(v.reshape(sample_output.shape))
2024-12-18T00:28:54.1727690Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 769, in vjp_fn
2024-12-18T00:28:54.1728439Z     return torch.autograd.grad(
2024-12-18T00:28:54.1729226Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/__init__.py", line 496, in grad
2024-12-18T00:28:54.1730034Z     result = _engine_run_backward(
2024-12-18T00:28:54.1730898Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/graph.py", line 823, in _engine_run_backward
2024-12-18T00:28:54.1732095Z     return Variable._execution_engine.run_backward(  # Calls into the C++ engine to run the backward pass
2024-12-18T00:28:54.1733837Z RuntimeError: result2.storage().use_count() == 1 INTERNAL ASSERT FAILED at "/var/lib/jenkins/workspace/torch/csrc/autograd/generated/VariableType_3.cpp":11909, please report a bug to PyTorch. function: linear_backward
2024-12-18T00:28:54.1735876Z Exception raised from linear_backward at /var/lib/jenkins/workspace/torch/csrc/autograd/generated/VariableType_3.cpp:11909 (most recent call first):
2024-12-18T00:28:54.1736956Z C++ CapturedTraceback:
2024-12-18T00:28:54.1738619Z #4 std::_Function_handler<std::shared_ptr<c10::LazyValue<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > const> (), c10::SetStackTraceFetcher(std::function<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > ()>)::{lambda()#1}>::_M_invoke(std::_Any_data const&) from Logging.cpp:0
2024-12-18T00:28:54.1740772Z #5 c10::Error::Error(c10::SourceLocation, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >) from ??:0
2024-12-18T00:28:54.1742211Z #6 c10::detail::torchCheckFail(char const*, char const*, unsigned int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) from ??:0
2024-12-18T00:28:54.1743594Z #7 c10::detail::torchInternalAssertFail(char const*, char const*, unsigned int, char const*, char const*) from ??:0
2024-12-18T00:28:54.1745165Z #8 torch::autograd::VariableType::(anonymous namespace)::linear_backward(c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from VariableType_3.cpp:0
2024-12-18T00:28:54.1749678Z #9 c10::impl::make_boxed_from_unboxed_functor<c10::impl::detail::WrapFunctionIntoFunctor_<c10::CompileTimeFunctionPointer<std::tuple<at::Tensor, at::Tensor, at::Tensor> (c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>), &torch::autograd::VariableType::(anonymous namespace)::linear_backward>, std::tuple<at::Tensor, at::Tensor, at::Tensor>, c10::guts::typelist::typelist<c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul> > >, false>::call(c10::OperatorKernel*, c10::OperatorHandle const&, c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) from VariableType_3.cpp:0
2024-12-18T00:28:54.1753157Z #10 c10::OperatorHandle::redispatchBoxed(c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) const from :0
2024-12-18T00:28:54.1754969Z #11 void c10::BoxedKernel::make_boxed_function<&(anonymous namespace)::pythonTLSSnapshotFallback>(c10::OperatorKernel*, c10::OperatorHandle const&, c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) from PythonFallbackKernel.cpp:0
2024-12-18T00:28:54.1758023Z #12 c10::impl::BoxedKernelWrapper<std::tuple<at::Tensor, at::Tensor, at::Tensor> (at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>), void>::call(c10::BoxedKernel const&, c10::OperatorHandle const&, c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from :0
2024-12-18T00:28:54.1759867Z #13 at::_ops::linear_backward::call(at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from ??:0
2024-12-18T00:28:54.1760932Z #14 torch::autograd::generated::LinearBackward0::apply(std::vector<at::Tensor, std::allocator<at::Tensor> >&&) from ??:0
2024-12-18T00:28:54.1761927Z #15 torch::autograd::Node::operator()(std::vector<at::Tensor, std::allocator<at::Tensor> >&&) from :0
2024-12-18T00:28:54.1763285Z #16 torch::autograd::Engine::evaluate_function(std::shared_ptr<torch::autograd::GraphTask>&, torch::autograd::Node*, torch::autograd::InputBuffer&, std::shared_ptr<torch::autograd::ReadyQueue> const&) from ??:0
2024-12-18T00:28:54.1764666Z #17 torch::autograd::Engine::thread_main(std::shared_ptr<torch::autograd::GraphTask> const&) from ??:0
2024-12-18T00:28:54.1765625Z #18 torch::autograd::Engine::thread_init(int, std::shared_ptr<torch::autograd::ReadyQueue> const&, bool) from ??:0
2024-12-18T00:28:54.1766714Z #19 torch::autograd::python::PythonEngine::thread_init(int, std::shared_ptr<torch::autograd::ReadyQueue> const&, bool) from ??:0
2024-12-18T00:28:54.1767562Z #20 execute_native_thread_routine from thread.cc:0
2024-12-18T00:28:54.1768198Z #21 start_thread from /build/glibc-LcI20x/glibc-2.31/nptl/pthread_create.c:477
2024-12-18T00:28:54.1768770Z #22 clone from ??:0
2024-12-18T00:28:54.1768972Z 
2024-12-18T00:28:54.1768989Z 
2024-12-18T00:28:54.1769257Z To execute this test, run the following from the base repo dir:
2024-12-18T00:28:54.1770015Z     python test/test_nestedtensor.py TestNestedTensorSubclassCUDA.test_linear_nt_dim_3_cuda
2024-12-18T00:28:54.1770561Z 
2024-12-18T00:28:54.1770860Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0
2024-12-18T00:28:54.1771572Z ----------------------------- Captured stderr call -----------------------------
2024-12-18T00:28:54.1773351Z /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nested/_internal/ops.py:576: UserWarning: Attempting to run cuBLAS, but there was no current CUDA context! Attempting to set the primary context... (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/cuda/CublasHandlePool.cpp:180.)
2024-12-18T00:28:54.1775153Z   torch.matmul(grad_output._values, weight), **extract_kwargs(grad_output)
2024-12-18T00:28:54.1775760Z =================================== FAILURES ===================================
2024-12-18T00:28:54.1776404Z ____________ TestNestedTensorSubclassCUDA.test_linear_nt_dim_3_cuda ____________
2024-12-18T00:28:54.1777178Z Traceback (most recent call last):
2024-12-18T00:28:54.1777815Z   File "/var/lib/jenkins/workspace/test/test_nestedtensor.py", line 3790, in test_linear
2024-12-18T00:28:54.1778447Z     gradcheck(
2024-12-18T00:28:54.1779177Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/testing/_internal/common_utils.py", line 4914, in gradcheck
2024-12-18T00:28:54.1780191Z     return torch.autograd.gradcheck(fn, inputs, **kwargs)
2024-12-18T00:28:54.1781042Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 2055, in gradcheck
2024-12-18T00:28:54.1781793Z     return _gradcheck_helper(**args)
2024-12-18T00:28:54.1782593Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 2084, in _gradcheck_helper
2024-12-18T00:28:54.1783398Z     _gradcheck_real_imag(
2024-12-18T00:28:54.1784173Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 1494, in _gradcheck_real_imag
2024-12-18T00:28:54.1784990Z     gradcheck_fn(
2024-12-18T00:28:54.1785696Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 1924, in _fast_gradcheck
2024-12-18T00:28:54.1786538Z     analytical_vJu = _get_analytical_vJu_backward_mode(
2024-12-18T00:28:54.1787478Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 807, in _get_analytical_vJu_backward_mode
2024-12-18T00:28:54.1788405Z     all_vJ = _check_analytical_jacobian_attributes(
2024-12-18T00:28:54.1789355Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 775, in _check_analytical_jacobian_attributes
2024-12-18T00:28:54.1790428Z     vjps1 = _get_analytical_vjps_wrt_specific_output(vjp_fn, output.clone(), v)
2024-12-18T00:28:54.1791489Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 909, in _get_analytical_vjps_wrt_specific_output
2024-12-18T00:28:54.1792437Z     grad_inputs = vjp_fn(v.reshape(sample_output.shape))
2024-12-18T00:28:54.1793254Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/gradcheck.py", line 769, in vjp_fn
2024-12-18T00:28:54.1794010Z     return torch.autograd.grad(
2024-12-18T00:28:54.1794707Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/__init__.py", line 496, in grad
2024-12-18T00:28:54.1795439Z     result = _engine_run_backward(
2024-12-18T00:28:54.1796221Z   File "/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/autograd/graph.py", line 823, in _engine_run_backward
2024-12-18T00:28:54.1797267Z     return Variable._execution_engine.run_backward(  # Calls into the C++ engine to run the backward pass
2024-12-18T00:28:54.1798835Z RuntimeError: result2.storage().use_count() == 1 INTERNAL ASSERT FAILED at "/var/lib/jenkins/workspace/torch/csrc/autograd/generated/VariableType_3.cpp":11909, please report a bug to PyTorch. function: linear_backward
2024-12-18T00:28:54.1800736Z Exception raised from linear_backward at /var/lib/jenkins/workspace/torch/csrc/autograd/generated/VariableType_3.cpp:11909 (most recent call first):
2024-12-18T00:28:54.1801738Z C++ CapturedTraceback:
2024-12-18T00:28:54.1803435Z #4 std::_Function_handler<std::shared_ptr<c10::LazyValue<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > const> (), c10::SetStackTraceFetcher(std::function<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > ()>)::{lambda()#1}>::_M_invoke(std::_Any_data const&) from Logging.cpp:0
2024-12-18T00:28:54.1805585Z #5 c10::Error::Error(c10::SourceLocation, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >) from ??:0
2024-12-18T00:28:54.1807029Z #6 c10::detail::torchCheckFail(char const*, char const*, unsigned int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) from ??:0
2024-12-18T00:28:54.1808413Z #7 c10::detail::torchInternalAssertFail(char const*, char const*, unsigned int, char const*, char const*) from ??:0
2024-12-18T00:28:54.1810095Z #8 torch::autograd::VariableType::(anonymous namespace)::linear_backward(c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from VariableType_3.cpp:0
2024-12-18T00:28:54.1814274Z #9 c10::impl::make_boxed_from_unboxed_functor<c10::impl::detail::WrapFunctionIntoFunctor_<c10::CompileTimeFunctionPointer<std::tuple<at::Tensor, at::Tensor, at::Tensor> (c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>), &torch::autograd::VariableType::(anonymous namespace)::linear_backward>, std::tuple<at::Tensor, at::Tensor, at::Tensor>, c10::guts::typelist::typelist<c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul> > >, false>::call(c10::OperatorKernel*, c10::OperatorHandle const&, c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) from VariableType_3.cpp:0
2024-12-18T00:28:54.1818067Z #10 c10::OperatorHandle::redispatchBoxed(c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) const from :0
2024-12-18T00:28:54.1820049Z #11 void c10::BoxedKernel::make_boxed_function<&(anonymous namespace)::pythonTLSSnapshotFallback>(c10::OperatorKernel*, c10::OperatorHandle const&, c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) from PythonFallbackKernel.cpp:0
2024-12-18T00:28:54.1822843Z #12 c10::impl::BoxedKernelWrapper<std::tuple<at::Tensor, at::Tensor, at::Tensor> (at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>), void>::call(c10::BoxedKernel const&, c10::OperatorHandle const&, c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from :0
2024-12-18T00:28:54.1824924Z #13 at::_ops::linear_backward::call(at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from ??:0
2024-12-18T00:28:54.1826085Z #14 torch::autograd::generated::LinearBackward0::apply(std::vector<at::Tensor, std::allocator<at::Tensor> >&&) from ??:0
2024-12-18T00:28:54.1827178Z #15 torch::autograd::Node::operator()(std::vector<at::Tensor, std::allocator<at::Tensor> >&&) from :0
2024-12-18T00:28:54.1828694Z #16 torch::autograd::Engine::evaluate_function(std::shared_ptr<torch::autograd::GraphTask>&, torch::autograd::Node*, torch::autograd::InputBuffer&, std::shared_ptr<torch::autograd::ReadyQueue> const&) from ??:0
2024-12-18T00:28:54.1830215Z #17 torch::autograd::Engine::thread_main(std::shared_ptr<torch::autograd::GraphTask> const&) from ??:0
2024-12-18T00:28:54.1831284Z #18 torch::autograd::Engine::thread_init(int, std::shared_ptr<torch::autograd::ReadyQueue> const&, bool) from ??:0
2024-12-18T00:28:54.1832487Z #19 torch::autograd::python::PythonEngine::thread_init(int, std::shared_ptr<torch::autograd::ReadyQueue> const&, bool) from ??:0
2024-12-18T00:28:54.1833416Z #20 execute_native_thread_routine from thread.cc:0
2024-12-18T00:28:54.1834090Z #21 start_thread from /build/glibc-LcI20x/glibc-2.31/nptl/pthread_create.c:477
2024-12-18T00:28:54.1834727Z #22 clone from ??:0
2024-12-18T00:28:54.1834955Z 
2024-12-18T00:28:54.1834972Z 
2024-12-18T00:28:54.1835239Z To execute this test, run the following from the base repo dir:
2024-12-18T00:28:54.1836073Z     python test/test_nestedtensor.py TestNestedTensorSubclassCUDA.test_linear_nt_dim_3_cuda
2024-12-18T00:28:54.1836652Z 
2024-12-18T00:28:54.1837002Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0
2024-12-18T00:28:54.1837757Z ----------------------------- Captured stderr call -----------------------------
2024-12-18T00:28:54.1839720Z /opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/nested/_internal/ops.py:576: UserWarning: Attempting to run cuBLAS, but there was no current CUDA context! Attempting to set the primary context... (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/cuda/CublasHandlePool.cpp:180.)
2024-12-18T00:28:54.1841687Z   torch.matmul(grad_output._values, weight), **extract_kwargs(grad_output)
2024-12-18T00:28:54.1842989Z - generated xml file: /var/lib/jenkins/workspace/test/test-reports/python-pytest/test_nestedtensor/test_nestedtensor-6205aa993cdfe70a.xml -
2024-12-18T00:28:54.1844086Z =========================== short test summary info ============================
2024-12-18T00:28:54.1846150Z FAILED [0.0257s] test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_nt_dim_3_cuda - RuntimeError: result2.storage().use_count() == 1 INTERNAL ASSERT FAILED at "/var/lib/jenkins/workspace/torch/csrc/autograd/generated/VariableType_3.cpp":11909, please report a bug to PyTorch. function: linear_backward
2024-12-18T00:28:54.1848676Z Exception raised from linear_backward at /var/lib/jenkins/workspace/torch/csrc/autograd/generated/VariableType_3.cpp:11909 (most recent call first):
2024-12-18T00:28:54.1848828Z C++ CapturedTraceback:
2024-12-18T00:28:54.1850297Z #4 std::_Function_handler<std::shared_ptr<c10::LazyValue<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > const> (), c10::SetStackTraceFetcher(std::function<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > ()>)::{lambda()#1}>::_M_invoke(std::_Any_data const&) from Logging.cpp:0
2024-12-18T00:28:54.1850874Z #5 c10::Error::Error(c10::SourceLocation, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >) from ??:0
2024-12-18T00:28:54.1851622Z #6 c10::detail::torchCheckFail(char const*, char const*, unsigned int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) from ??:0
2024-12-18T00:28:54.1852145Z #7 c10::detail::torchInternalAssertFail(char const*, char const*, unsigned int, char const*, char const*) from ??:0
2024-12-18T00:28:54.1853060Z #8 torch::autograd::VariableType::(anonymous namespace)::linear_backward(c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from VariableType_3.cpp:0
2024-12-18T00:28:54.1856433Z #9 c10::impl::make_boxed_from_unboxed_functor<c10::impl::detail::WrapFunctionIntoFunctor_<c10::CompileTimeFunctionPointer<std::tuple<at::Tensor, at::Tensor, at::Tensor> (c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>), &torch::autograd::VariableType::(anonymous namespace)::linear_backward>, std::tuple<at::Tensor, at::Tensor, at::Tensor>, c10::guts::typelist::typelist<c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul> > >, false>::call(c10::OperatorKernel*, c10::OperatorHandle const&, c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) from VariableType_3.cpp:0
2024-12-18T00:28:54.1857038Z #10 c10::OperatorHandle::redispatchBoxed(c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) const from :0
2024-12-18T00:28:54.1858185Z #11 void c10::BoxedKernel::make_boxed_function<&(anonymous namespace)::pythonTLSSnapshotFallback>(c10::OperatorKernel*, c10::OperatorHandle const&, c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) from PythonFallbackKernel.cpp:0
2024-12-18T00:28:54.1859465Z #12 c10::impl::BoxedKernelWrapper<std::tuple<at::Tensor, at::Tensor, at::Tensor> (at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>), void>::call(c10::BoxedKernel const&, c10::OperatorHandle const&, c10::DispatchKeySet, at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from :0
2024-12-18T00:28:54.1859938Z #13 at::_ops::linear_backward::call(at::Tensor const&, at::Tensor const&, at::Tensor const&, std::array<bool, 3ul>) from ??:0
2024-12-18T00:28:54.1860421Z #14 torch::autograd::generated::LinearBackward0::apply(std::vector<at::Tensor, std::allocator<at::Tensor> >&&) from ??:0
2024-12-18T00:28:54.1860817Z #15 torch::autograd::Node::operator()(std::vector<at::Tensor, std::allocator<at::Tensor> >&&) from :0
2024-12-18T00:28:54.1861666Z #16 torch::autograd::Engine::evaluate_function(std::shared_ptr<torch::autograd::GraphTask>&, torch::autograd::Node*, torch::autograd::InputBuffer&, std::shared_ptr<torch::autograd::ReadyQueue> const&) from ??:0
2024-12-18T00:28:54.1862221Z #17 torch::autograd::Engine::thread_main(std::shared_ptr<torch::autograd::GraphTask> const&) from ??:0
2024-12-18T00:28:54.1862680Z #18 torch::autograd::Engine::thread_init(int, std::shared_ptr<torch::autograd::ReadyQueue> const&, bool) from ??:0
2024-12-18T00:28:54.1863294Z #19 torch::autograd::python::PythonEngine::thread_init(int, std::shared_ptr<torch::autograd::ReadyQueue> const&, bool) from ??:0
2024-12-18T00:28:54.1863531Z #20 execute_native_thread_routine from thread.cc:0
2024-12-18T00:28:54.1863844Z #21 start_thread from /build/glibc-LcI20x/glibc-2.31/nptl/pthread_create.c:477
2024-12-18T00:28:54.1863999Z #22 clone from ??:0
2024-12-18T00:28:54.1864018Z 
2024-12-18T00:28:54.1864035Z 
2024-12-18T00:28:54.1864288Z To execute this test, run the following from the base repo dir:
2024-12-18T00:28:54.1864707Z     python test/test_nestedtensor.py TestNestedTensorSubclassCUDA.test_linear_nt_dim_3_cuda
2024-12-18T00:28:54.1864731Z 
2024-12-18T00:28:54.1865036Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0
2024-12-18T00:28:54.1865275Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!!
2024-12-18T00:28:54.1865515Z ================= 1 failed, 1568 deselected, 2 rerun in 0.61s ==================
2024-12-18T00:28:54.1865656Z Got exit code 1
2024-12-18T00:28:54.1865836Z Stopping at first consistent failure
2024-12-18T00:28:54.1866412Z The following tests failed consistently: ['test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_nt_dim_3_cuda']
2024-12-18T00:28:54.1866430Z 
2024-12-18T00:28:54.1866928Z FINISHED PRINTING LOG FILE of test_nestedtensor 1/1 (test/test-reports/test_nestedtensor_1.1_e97c0bc164da9cc7_.log)
2024-12-18T00:28:54.1866946Z 
2024-12-18T00:28:54.1867099Z test_nestedtensor 1/1 failed!
2024-12-18T00:28:54.4630002Z Uploading artifacts took 0.58 seconds
2024-12-18T00:28:54.5095577Z Running test batch 'tests to run' cost 899.37 seconds
2024-12-18T00:28:54.5111112Z Emiting td_test_failure_stats_v2
2024-12-18T00:28:54.5115470Z Writing 1 documents to S3
2024-12-18T00:28:54.6139135Z Done!
2024-12-18T00:28:54.6140542Z test_nestedtensor 1/1 failed!
2024-12-18T00:28:55.4419663Z 
2024-12-18T00:28:55.4420311Z real	15m6.785s
2024-12-18T00:28:55.4420795Z user	16m42.312s
2024-12-18T00:28:55.4421144Z sys	4m12.930s
2024-12-18T00:28:55.4421597Z + cleanup_workspace
2024-12-18T00:28:55.4422453Z + echo 'sudo may print the following warning message that can be ignored. The chown command will still run.'
2024-12-18T00:28:55.4423727Z sudo may print the following warning message that can be ignored. The chown command will still run.
2024-12-18T00:28:55.4424802Z + echo '    sudo: setrlimit(RLIMIT_STACK): Operation not permitted'
2024-12-18T00:28:55.4425630Z     sudo: setrlimit(RLIMIT_STACK): Operation not permitted
2024-12-18T00:28:55.4426456Z + echo 'For more details refer to https://github.com/sudo-project/sudo/issues/42'
2024-12-18T00:28:55.4427475Z For more details refer to https://github.com/sudo-project/sudo/issues/42
2024-12-18T00:28:55.4428132Z + sudo chown -R 1000 /var/lib/jenkins/workspace
2024-12-18T00:28:56.0621861Z ##[error]Process completed with exit code 1.
2024-12-18T00:28:56.0754423Z Prepare all required actions
2024-12-18T00:28:56.0755400Z Getting action download info
2024-12-18T00:28:56.3592893Z ##[group]Run ./.github/actions/pytest-cache-upload
2024-12-18T00:28:56.3593405Z with:
2024-12-18T00:28:56.3593739Z   cache_dir: .pytest_cache
2024-12-18T00:28:56.3594111Z   shard: 4
2024-12-18T00:28:56.3594491Z   sha: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:28:56.3594974Z   test_config: default
2024-12-18T00:28:56.3595506Z   job_identifier: periodic_linux-focal-cuda11.8-py3.10-gcc9-debug
2024-12-18T00:28:56.3596093Z env:
2024-12-18T00:28:56.3596428Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:28:56.3596928Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:28:56.3597705Z   DOCKER_CONTAINER_ID: bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:28:56.3598636Z ##[endgroup]
2024-12-18T00:28:56.3647224Z ##[group]Run nick-fields/retry@v3.0.0
2024-12-18T00:28:56.3647671Z with:
2024-12-18T00:28:56.3648023Z   shell: bash
2024-12-18T00:28:56.3648364Z   timeout_minutes: 5
2024-12-18T00:28:56.3648704Z   max_attempts: 5
2024-12-18T00:28:56.3649054Z   retry_wait_seconds: 30
2024-12-18T00:28:56.3649550Z   command: set -eu
python3 -m pip install boto3==1.35.42

2024-12-18T00:28:56.3650096Z   polling_interval_seconds: 1
2024-12-18T00:28:56.3650519Z   warning_on_retry: true
2024-12-18T00:28:56.3650888Z   continue_on_error: false
2024-12-18T00:28:56.3651270Z env:
2024-12-18T00:28:56.3651580Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:28:56.3652066Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:28:56.3652832Z   DOCKER_CONTAINER_ID: bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:28:56.3653511Z ##[endgroup]
2024-12-18T00:28:56.8368418Z Defaulting to user installation because normal site-packages is not writeable
2024-12-18T00:28:58.3375732Z Collecting boto3==1.35.42
2024-12-18T00:28:58.3865316Z   Downloading boto3-1.35.42-py3-none-any.whl (139 kB)
2024-12-18T00:28:58.4237559Z Requirement already satisfied: botocore<1.36.0,>=1.35.42 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.42) (1.35.83)
2024-12-18T00:28:58.4243479Z Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /usr/lib/python3.9/site-packages (from boto3==1.35.42) (0.10.0)
2024-12-18T00:28:58.4251850Z Requirement already satisfied: s3transfer<0.11.0,>=0.10.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.42) (0.10.4)
2024-12-18T00:28:58.4330264Z Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.42->boto3==1.35.42) (2.8.1)
2024-12-18T00:28:58.4346887Z Requirement already satisfied: urllib3<1.27,>=1.25.4 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.42->boto3==1.35.42) (1.25.10)
2024-12-18T00:28:58.4404945Z Requirement already satisfied: six>=1.5 in /usr/lib/python3.9/site-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.42->boto3==1.35.42) (1.15.0)
2024-12-18T00:28:58.5668618Z Installing collected packages: boto3
2024-12-18T00:28:58.5670967Z   Attempting uninstall: boto3
2024-12-18T00:28:58.5671431Z     Found existing installation: boto3 1.35.33
2024-12-18T00:28:58.5820386Z     Uninstalling boto3-1.35.33:
2024-12-18T00:28:58.5839732Z       Successfully uninstalled boto3-1.35.33
2024-12-18T00:28:58.6651970Z Successfully installed boto3-1.35.42
2024-12-18T00:28:59.4739095Z Command completed after 1 attempt(s).
2024-12-18T00:28:59.4803446Z ##[group]Run python3 .github/scripts/pytest_cache.py \
2024-12-18T00:28:59.4804041Z python3 .github/scripts/pytest_cache.py \
2024-12-18T00:28:59.4804521Z   --upload \
2024-12-18T00:28:59.4804933Z   --cache_dir $GITHUB_WORKSPACE/$CACHE_DIR \
2024-12-18T00:28:59.4805436Z   --pr_identifier $GITHUB_REF \
2024-12-18T00:28:59.4805994Z   --job_identifier $JOB_IDENTIFIER \
2024-12-18T00:28:59.4806439Z   --sha $SHA \
2024-12-18T00:28:59.4807064Z   --test_config $TEST_CONFIG \
2024-12-18T00:28:59.4807517Z   --shard $SHARD \
2024-12-18T00:28:59.4807881Z   --repo $REPO \
2024-12-18T00:28:59.4808263Z   --temp_dir $RUNNER_TEMP \
2024-12-18T00:28:59.4818867Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:28:59.4819368Z env:
2024-12-18T00:28:59.4819678Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:28:59.4820133Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:28:59.4820843Z   DOCKER_CONTAINER_ID: bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:28:59.4821488Z   CACHE_DIR: .pytest_cache
2024-12-18T00:28:59.4821977Z   JOB_IDENTIFIER: periodic_linux-focal-cuda11.8-py3.10-gcc9-debug
2024-12-18T00:28:59.4822568Z   SHA: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:28:59.4823238Z   TEST_CONFIG: default
2024-12-18T00:28:59.4823580Z   SHARD: 4
2024-12-18T00:28:59.4823896Z   REPO: pytorch/pytorch
2024-12-18T00:28:59.4824228Z ##[endgroup]
2024-12-18T00:28:59.9333626Z PR identifier for `refs/heads/release/2.6` is `34bd5c03b81e6d598f3b485a20400869`
2024-12-18T00:28:59.9336102Z Uploading cache with args Namespace(upload=True, download=False, cache_dir='/home/ec2-user/actions-runner/_work/pytorch/pytorch/.pytest_cache', pr_identifier='refs/heads/release/2.6', job_identifier='periodic_linux-focal-cuda11.8-py3.10-gcc9-debug', sha='0cdf8b1d09254cfda66191d1bd01e3041c3c76f7', test_config='default', shard='4', repo='pytorch/pytorch', temp_dir='/home/ec2-user/actions-runner/_work/_temp', bucket=None)
2024-12-18T00:28:59.9338447Z Zipping /home/ec2-user/actions-runner/_work/pytorch/pytorch/.pytest_cache
2024-12-18T00:28:59.9339943Z      to /home/ec2-user/actions-runner/_work/_temp/zip-upload/pytest_cache/pytorch/pytorch/34bd5c03b81e6d598f3b485a20400869/periodic_linux-focal-cuda11_8-py3_10-gcc9-debug/0cdf8b1d09254cfda66191d1bd01e3041c3c76f7/default/4
2024-12-18T00:28:59.9342270Z Uploading /home/ec2-user/actions-runner/_work/_temp/zip-upload/pytest_cache/pytorch/pytorch/34bd5c03b81e6d598f3b485a20400869/periodic_linux-focal-cuda11_8-py3_10-gcc9-debug/0cdf8b1d09254cfda66191d1bd01e3041c3c76f7/default/4.zip
2024-12-18T00:28:59.9344454Z        to s3://gha-artifacts/pytest_cache/pytorch/pytorch/34bd5c03b81e6d598f3b485a20400869/periodic_linux-focal-cuda11_8-py3_10-gcc9-debug/0cdf8b1d09254cfda66191d1bd01e3041c3c76f7/default/4.zip
2024-12-18T00:28:59.9919494Z ##[group]Run cat test/**/*_toprint.log || true
2024-12-18T00:28:59.9920068Z cat test/**/*_toprint.log || true
2024-12-18T00:28:59.9927752Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:28:59.9928257Z env:
2024-12-18T00:28:59.9928575Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:28:59.9929035Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:28:59.9929766Z   DOCKER_CONTAINER_ID: bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:28:59.9930388Z ##[endgroup]
2024-12-18T00:29:00.0016984Z Test results will be stored in test-reports/python-pytest/inductor.test_cpu_repro/inductor.test_cpu_repro-c8c634a2d3ed86ea.xml
2024-12-18T00:29:00.0035801Z ============================= test session starts ==============================
2024-12-18T00:29:00.0036737Z platform linux -- Python 3.10.15, pytest-7.3.2, pluggy-1.5.0 -- /opt/conda/envs/py_3.10/bin/python
2024-12-18T00:29:00.0037403Z cachedir: .pytest_cache
2024-12-18T00:29:00.0038259Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow]
2024-12-18T00:29:00.0039103Z rootdir: /var/lib/jenkins/workspace
2024-12-18T00:29:00.0039508Z configfile: pytest.ini
2024-12-18T00:29:00.0040297Z plugins: hypothesis-5.35.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, subtests-0.13.1, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0
2024-12-18T00:29:00.0041163Z collecting ... collected 712 items
2024-12-18T00:29:00.0041643Z stepcurrent: Cannot find last run test, not skipping
2024-12-18T00:29:00.0122957Z Running 107 items in this shard: test/inductor/test_cpu_repro.py::CPUReproTests::test_add_layernorm, test/inductor/test_cpu_repro.py::CPUReproTests::test_aten_normal_dtype, test/inductor/test_cpu_repro.py::CPUReproTests::test_avx2_bool_constant_pad_nd, test/inductor/test_cpu_repro.py::CPUReproTests::test_constant_bool_vec, test/inductor/test_cpu_repro.py::CPUReproTests::test_conv2d_autocast, test/inductor/test_cpu_repro.py::CPUReproTests::test_convert_fp32_int64_oob_vec, test/inductor/test_cpu_repro.py::CPUReproTests::test_convert_fp32_to_int64_vec, test/inductor/test_cpu_repro.py::CPUReproTests::test_decomposed_fake_quant_per_channel, test/inductor/test_cpu_repro.py::CPUReproTests::test_double_pointwise_vec, test/inductor/test_cpu_repro.py::CPUReproTests::test_full_bits_lowp, test/inductor/test_cpu_repro.py::CPUReproTests::test_int32_pointwise_vec, test/inductor/test_cpu_repro.py::CPUReproTests::test_int64_reduction_vec, test/inductor/test_cpu_repro.py::CPUReproTests::test_linear_with_reshape, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_1_bidirectional_False_bias_True_empty_state_True_batch_first_False_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_1_bidirectional_False_bias_True_empty_state_True_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_False_empty_state_True_batch_first_True_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_True_empty_state_False_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_True_empty_state_False_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_True_empty_state_False_batch_first_True_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_True_empty_state_True_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_True_empty_state_True_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_True_empty_state_True_batch_first_True_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_False_empty_state_False_batch_first_True_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_False_empty_state_True_batch_first_False_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_False_empty_state_True_batch_first_True_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_False_empty_state_True_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_False_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_True_batch_first_True_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_True_batch_first_True_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_True_bias_False_empty_state_False_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_True_bias_False_empty_state_False_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_True_bias_False_empty_state_False_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_True_bias_False_empty_state_True_batch_first_False_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_True_bias_False_empty_state_True_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_False_batch_first_False_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_True_batch_first_True_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_False_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_1_bidirectional_False_bias_True_empty_state_True_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_1_bidirectional_True_bias_False_empty_state_False_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_1_bidirectional_True_bias_False_empty_state_True_batch_first_True_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_7_bidirectional_False_bias_False_empty_state_True_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_False_batch_first_True_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_False_empty_state_False_batch_first_False_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_False_empty_state_True_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_True_batch_first_False_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_True_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_True_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_True_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_False_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_True_batch_first_False_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_1_bidirectional_False_bias_True_empty_state_False_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_1_bidirectional_False_bias_True_empty_state_True_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_False_empty_state_False_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_False_empty_state_False_batch_first_True_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_False_empty_state_True_batch_first_False_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_False_empty_state_True_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_False_empty_state_True_batch_first_True_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_True_empty_state_False_batch_first_True_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_True_empty_state_True_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_True_empty_state_True_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_False_empty_state_False_batch_first_False_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_False_empty_state_True_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_False_batch_first_True_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_False_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_7_bidirectional_True_bias_False_empty_state_True_batch_first_False_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_7_bidirectional_True_bias_False_empty_state_True_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_False_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_False_batch_first_False_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_False_batch_first_True_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_1_bidirectional_False_bias_True_empty_state_True_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_1_bidirectional_True_bias_False_empty_state_False_batch_first_True_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_1_bidirectional_True_bias_False_empty_state_True_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_1_bidirectional_True_bias_False_empty_state_True_batch_first_False_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_1_bidirectional_True_bias_True_empty_state_False_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_False_bias_False_empty_state_True_batch_first_False_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_False_bias_False_empty_state_True_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_False_bias_False_empty_state_True_batch_first_True_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_False_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_False_batch_first_True_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_True_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_True_batch_first_False_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_True_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_False_empty_state_False_batch_first_False_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_False_empty_state_True_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_False_batch_first_False_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_False_batch_first_False_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_True_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_True_batch_first_False_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_True_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_masked_fill_softmax, test/inductor/test_cpu_repro.py::CPUReproTests::test_masked_fill_with_inf_or_nan_value, test/inductor/test_cpu_repro.py::CPUReproTests::test_no_redundant_to_dtypes_between_fused_scheduler_node, test/inductor/test_cpu_repro.py::CPUReproTests::test_non_contiguous_load_buf_quant_int8, test/inductor/test_cpu_repro.py::CPUReproTests::test_outer_loop_fusion, test/inductor/test_cpu_repro.py::CPUReproTests::test_pad_with_nan_value, test/inductor/test_cpu_repro.py::CPUReproTests::test_per_channel_fake_quant_int8, test/inductor/test_cpu_repro.py::CPUReproTests::test_per_channel_fake_quant_uint8, test/inductor/test_cpu_repro.py::CPUReproTests::test_per_tensor_fake_quant_int8, test/inductor/test_cpu_repro.py::CPUReproTests::test_randint_symint_input, test/inductor/test_cpu_repro.py::CPUReproTests::test_reduction_with_dynamic_threads, test/inductor/test_cpu_repro.py::CPUReproTests::test_scalar_sign_with_min, test/inductor/test_cpu_repro.py::CPUReproTests::test_slice_scatter_default_end_value, test/inductor/test_cpu_repro.py::CPUReproTests::test_tile2d_store_channel_shuffle_cl_quant_output_uint8, test/inductor/test_cpu_repro.py::CPUReproTests::test_timed_cpu_only, test/inductor/test_cpu_repro.py::CPUReproTests::test_transpose_mxn_16_16_bf16_fp16, test/inductor/test_cpu_repro.py::CPUReproTests::test_transpose_non_contiguous, test/inductor/test_cpu_repro.py::CPUReproTests::test_vec_compare_op_cpu_only
2024-12-18T00:29:00.0203397Z 
2024-12-18T00:29:00.0203775Z inductor/test_cpu_repro.py::CPUReproTests::test_add_layernorm PASSED [7.1648s] [  0%]
2024-12-18T00:29:00.0204715Z inductor/test_cpu_repro.py::CPUReproTests::test_aten_normal_dtype ('RERUN', {'yellow': True}) [0.6610s] [  1%]
2024-12-18T00:29:00.0205588Z inductor/test_cpu_repro.py::CPUReproTests::test_aten_normal_dtype 
2024-12-18T00:29:00.0247515Z ##[group]Run kill "$MONITOR_SCRIPT_PID"
2024-12-18T00:29:00.0248073Z kill "$MONITOR_SCRIPT_PID"
2024-12-18T00:29:00.0255072Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:29:00.0255597Z env:
2024-12-18T00:29:00.0255902Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:29:00.0256846Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:29:00.0257536Z   DOCKER_CONTAINER_ID: bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:29:00.0258188Z   MONITOR_SCRIPT_PID: 123545
2024-12-18T00:29:00.0258541Z ##[endgroup]
2024-12-18T00:29:00.0444450Z Prepare all required actions
2024-12-18T00:29:00.0445049Z Getting action download info
2024-12-18T00:29:00.2461594Z Download action repository 'actions/upload-artifact@v4' (SHA:6f51ac03b9356f520e9adb1b1b7802705f340c2b)
2024-12-18T00:29:00.6354833Z ##[group]Run ./.github/actions/upload-test-artifacts
2024-12-18T00:29:00.6355317Z with:
2024-12-18T00:29:00.6355772Z   file-suffix: test-default-4-5-lf.linux.4xlarge.nvidia.gpu_34566510375
2024-12-18T00:29:00.6356888Z   s3-bucket: gha-artifacts
2024-12-18T00:29:00.6357257Z env:
2024-12-18T00:29:00.6357557Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:29:00.6358013Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:29:00.6358717Z   DOCKER_CONTAINER_ID: bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:29:00.6359331Z ##[endgroup]
2024-12-18T00:29:00.6400996Z ##[group]Run # Remove any previous test jsons if they exist
2024-12-18T00:29:00.6401765Z # Remove any previous test jsons if they exist
2024-12-18T00:29:00.6402250Z rm -f test-jsons-*.zip
2024-12-18T00:29:00.6402807Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test/test-reports -i '*.json'
2024-12-18T00:29:00.6409870Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:29:00.6410370Z env:
2024-12-18T00:29:00.6410677Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:29:00.6411130Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:29:00.6411818Z   DOCKER_CONTAINER_ID: bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:29:00.6412612Z   FILE_SUFFIX: test-default-4-5-lf.linux.4xlarge.nvidia.gpu_34566510375
2024-12-18T00:29:00.6413167Z ##[endgroup]
2024-12-18T00:29:00.6488053Z   adding: test/test-reports/td_exclusions-d0fbbcab0317149acacb.json (deflated 82%)
2024-12-18T00:29:00.6527113Z ##[group]Run # Remove any previous test reports if they exist
2024-12-18T00:29:00.6527982Z # Remove any previous test reports if they exist
2024-12-18T00:29:00.6528536Z rm -f test-reports-*.zip
2024-12-18T00:29:00.6529194Z zip -r "test-reports-${FILE_SUFFIX}.zip" test/test-reports -i '*.xml' -i '*.csv'
2024-12-18T00:29:00.6536260Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:29:00.6536795Z env:
2024-12-18T00:29:00.6537112Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:29:00.6537602Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:29:00.6538369Z   DOCKER_CONTAINER_ID: bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:29:00.6539240Z   FILE_SUFFIX: test-default-4-5-lf.linux.4xlarge.nvidia.gpu_34566510375
2024-12-18T00:29:00.6539821Z ##[endgroup]
2024-12-18T00:29:00.6611713Z   adding: test/test-reports/python-pytest/test_nestedtensor/test_nestedtensor-00082f3bba59ab50.xml (deflated 28%)
2024-12-18T00:29:00.6623390Z   adding: test/test-reports/python-pytest/test_nestedtensor/test_nestedtensor-a57b624bf94dd066.xml (deflated 94%)
2024-12-18T00:29:00.6627316Z   adding: test/test-reports/python-pytest/test_nestedtensor/test_nestedtensor-e984fecf6c35c4f2.xml (deflated 93%)
2024-12-18T00:29:00.6631169Z   adding: test/test-reports/python-pytest/test_nestedtensor/test_nestedtensor-6205aa993cdfe70a.xml (deflated 93%)
2024-12-18T00:29:00.6632337Z   adding: test/test-reports/python-pytest/dynamo.test_after_aot/dynamo.test_after_aot-ccb3cae6d48ec290.xml (deflated 28%)
2024-12-18T00:29:00.6633524Z   adding: test/test-reports/python-pytest/dynamo.test_after_aot/dynamo.test_after_aot-fc8cbd2e700e9381.xml (deflated 49%)
2024-12-18T00:29:00.6634757Z   adding: test/test-reports/python-pytest/inductor.test_cpu_repro/inductor.test_cpu_repro-9c366815b66dada8.xml (deflated 28%)
2024-12-18T00:29:00.6636027Z   adding: test/test-reports/python-pytest/dynamo.test_higher_order_ops/dynamo.test_higher_order_ops-1a77601f9a6231cc.xml (deflated 28%)
2024-12-18T00:29:00.6637265Z   adding: test/test-reports/python-pytest/dynamo.test_repros/dynamo.test_repros-eee73190a79ae275.xml (deflated 28%)
2024-12-18T00:29:00.6638786Z   adding: test/test-reports/python-pytest/inductor.test_inductor_freezing/inductor.test_inductor_freezing-1ba3285bee875164.xml (deflated 28%)
2024-12-18T00:29:00.6640133Z   adding: test/test-reports/python-pytest/dynamo.test_backends/dynamo.test_backends-cc3a7028f564b8de.xml (deflated 29%)
2024-12-18T00:29:00.6641354Z   adding: test/test-reports/python-pytest/inductor.test_mmdecomp/inductor.test_mmdecomp-ff4dffa7c85c70d5.xml (deflated 28%)
2024-12-18T00:29:00.6642542Z   adding: test/test-reports/python-pytest/dynamo.test_misc/dynamo.test_misc-f57edfacb4d8eb47.xml (deflated 28%)
2024-12-18T00:29:00.6643666Z   adding: test/test-reports/python-pytest/dynamo.test_logging/dynamo.test_logging-7c81e26ba4aa15af.xml (deflated 28%)
2024-12-18T00:29:00.6644951Z   adding: test/test-reports/python-pytest/inductor.test_compiled_autograd/inductor.test_compiled_autograd-89e331ae573e3fe7.xml (deflated 28%)
2024-12-18T00:29:00.6646399Z   adding: test/test-reports/python-pytest/inductor.test_aot_inductor_arrayref/inductor.test_aot_inductor_arrayref-837683d2638cd17c.xml (deflated 27%)
2024-12-18T00:29:00.6647781Z   adding: test/test-reports/python-pytest/torch_np.test_binary_ufuncs/torch_np.test_binary_ufuncs-83845bcca45b68fa.xml (deflated 28%)
2024-12-18T00:29:00.6649188Z   adding: test/test-reports/python-pytest/export.test_export_training_ir_to_run_decomp/export.test_export_training_ir_to_run_decomp-95fd88041f683e5c.xml (deflated 28%)
2024-12-18T00:29:00.6650712Z   adding: test/test-reports/python-pytest/export.test_unflatten_training_ir/export.test_unflatten_training_ir-882c28327f91755a.xml (deflated 28%)
2024-12-18T00:29:00.6652027Z   adding: test/test-reports/python-pytest/inductor.test_config/inductor.test_config-e3255409a637fb87.xml (deflated 27%)
2024-12-18T00:29:00.6653257Z   adding: test/test-reports/python-pytest/inductor.test_debug_trace/inductor.test_debug_trace-81d411637a52ec66.xml (deflated 28%)
2024-12-18T00:29:00.6654755Z   adding: test/test-reports/python-pytest/inductor.test_external_callables/inductor.test_external_callables-00ce203989d09b23.xml (deflated 28%)
2024-12-18T00:29:00.6656666Z   adding: test/test-reports/python-pytest/inductor.test_mkldnn_pattern_matcher/inductor.test_mkldnn_pattern_matcher-f034298b27a2b7a8.xml (deflated 28%)
2024-12-18T00:29:00.6658098Z   adding: test/test-reports/python-pytest/inductor.test_inductor_utils/inductor.test_inductor_utils-12492e2b21bbd3db.xml (deflated 28%)
2024-12-18T00:29:00.6659484Z   adding: test/test-reports/python-pytest/inductor.test_torchinductor_opinfo/inductor.test_torchinductor_opinfo-a5c3221706b5d814.xml (deflated 28%)
2024-12-18T00:29:00.6660974Z   adding: test/test-reports/python-pytest/inductor.test_compiled_optimizers/inductor.test_compiled_optimizers-ef714ed071e9f21a.xml (deflated 28%)
2024-12-18T00:29:00.6662310Z   adding: test/test-reports/python-pytest/dynamo.test_base_output/dynamo.test_base_output-3393e67c8fdb65d9.xml (deflated 28%)
2024-12-18T00:29:00.6663498Z   adding: test/test-reports/python-pytest/test_import_stats/test_import_stats-cb2a461ea5c36b48.xml (deflated 28%)
2024-12-18T00:29:00.6664622Z   adding: test/test-reports/python-pytest/test_binary_ufuncs/test_binary_ufuncs-a4d57f5b71f4e665.xml (deflated 28%)
2024-12-18T00:29:00.6666072Z   adding: test/test-reports/python-pytest/inductor.test_torchinductor_codegen_dynamic_shapes/inductor.test_torchinductor_codegen_dynamic_shapes-ed57b6aad450df67.xml (deflated 46%)
2024-12-18T00:29:00.6667811Z   adding: test/test-reports/python-pytest/inductor.test_torchinductor_dynamic_shapes/inductor.test_torchinductor_dynamic_shapes-78a95668e36552d2.xml (deflated 46%)
2024-12-18T00:29:00.6669316Z   adding: test/test-reports/python-pytest/dynamo.test_fx_passes_pre_grad/dynamo.test_fx_passes_pre_grad-b21a89925dfa6d31.xml (deflated 28%)
2024-12-18T00:29:00.6670807Z   adding: test/test-reports/python-pytest/dynamo.test_cudagraphs_expandable_segments/dynamo.test_cudagraphs_expandable_segments-cbc416ed4b2d8fb6.xml (deflated 28%)
2024-12-18T00:29:00.6672379Z   adding: test/test-reports/python-pytest/dynamo.test_modules/dynamo.test_modules-7aeb4b7a5543fb31.xml (deflated 28%)
2024-12-18T00:29:00.6673660Z   adding: test/test-reports/python-pytest/inductor.test_combo_kernels/inductor.test_combo_kernels-cc62a4eec5317c0b.xml (deflated 28%)
2024-12-18T00:29:00.6674985Z   adding: test/test-reports/python-pytest/dynamo.test_skip_non_tensor/dynamo.test_skip_non_tensor-1e8c531948ef3be5.xml (deflated 28%)
2024-12-18T00:29:00.6676421Z   adding: test/test-reports/python-pytest/functorch.test_ops/functorch.test_ops-92a09c6de5ddccaa.xml (deflated 28%)
2024-12-18T00:29:00.6677584Z   adding: test/test-reports/python-pytest/functorch.test_ops/functorch.test_ops-8313c5146df53f31.xml (deflated 28%)
2024-12-18T00:29:00.6678731Z   adding: test/test-reports/python-pytest/functorch.test_ops/functorch.test_ops-57bf064cc9cac983.xml (deflated 27%)
2024-12-18T00:29:00.6679801Z   adding: test/test-reports/python-pytest/xpu.test_conv/xpu.test_conv-8ac8185fcd075a15.xml (deflated 28%)
2024-12-18T00:29:00.6680924Z   adding: test/test-reports/python-pytest/test_ops_fwd_gradients/test_ops_fwd_gradients-db0eabfc20fdd8e1.xml (deflated 27%)
2024-12-18T00:29:00.6682285Z   adding: test/test-reports/python-pytest/dynamo.test_backward_higher_order_ops/dynamo.test_backward_higher_order_ops-c0858ebe7ead9e31.xml (deflated 29%)
2024-12-18T00:29:00.6684257Z   adding: test/test-reports/python-pytest/dynamo.test_sources/dynamo.test_sources-edc53efad721a876.xml (deflated 29%)
2024-12-18T00:29:00.6685473Z   adding: test/test-reports/python-pytest/dynamo.test_model_output/dynamo.test_model_output-a07f5af1721c733b.xml (deflated 28%)
2024-12-18T00:29:00.6686824Z   adding: test/test-reports/python-pytest/higher_order_ops.test_with_effects/higher_order_ops.test_with_effects-0692c65e3a29b2c5.xml (deflated 28%)
2024-12-18T00:29:00.6688109Z   adding: test/test-reports/python-pytest/export.test_passes/export.test_passes-74ed0c9a9ead3f42.xml (deflated 28%)
2024-12-18T00:29:00.6689539Z   adding: test/test-reports/python-pytest/dynamo.test_structured_trace/dynamo.test_structured_trace-761348145d19db8e.xml (deflated 28%)
2024-12-18T00:29:00.6691108Z   adding: test/test-reports/python-pytest/inductor.test_torchinductor_codegen_config_overrides/inductor.test_torchinductor_codegen_config_overrides-722f50d44802a1c1.xml (deflated 28%)
2024-12-18T00:29:00.6692647Z   adding: test/test-reports/python-pytest/dynamo.test_decorators/dynamo.test_decorators-daae690cbc148c00.xml (deflated 28%)
2024-12-18T00:29:00.6693836Z   adding: test/test-reports/python-pytest/lazy.test_ts_opinfo/lazy.test_ts_opinfo-12ccd5d846500c67.xml (deflated 28%)
2024-12-18T00:29:00.6695098Z   adding: test/test-reports/python-pytest/inductor.test_fused_attention/inductor.test_fused_attention-c80b093997c2a404.xml (deflated 28%)
2024-12-18T00:29:00.6696284Z   adding: test/test-reports/python-pytest/test_ops_jit/test_ops_jit-d404e721adefe011.xml (deflated 28%)
2024-12-18T00:29:00.6697249Z   adding: test/test-reports/python-pytest/test_ops/test_ops-689771c82d88a930.xml (deflated 27%)
2024-12-18T00:29:00.6698211Z   adding: test/test-reports/python-pytest/test_ops/test_ops-2d3d7d4f46fbbbcf.xml (deflated 28%)
2024-12-18T00:29:00.6699122Z   adding: test/test-reports/python-pytest/test_ops/test_ops-6eb910d988a9aa85.xml (deflated 28%)
2024-12-18T00:29:00.6700244Z   adding: test/test-reports/python-pytest/test_expanded_weights/test_expanded_weights-ffe3e2d5753d2404.xml (deflated 28%)
2024-12-18T00:29:00.6701568Z   adding: test/test-reports/python-pytest/test_compile_benchmark_util/test_compile_benchmark_util-ce22bdee4732f4cd.xml (deflated 28%)
2024-12-18T00:29:00.6703058Z   adding: test/test-reports/python-pytest/torch_np.numpy_tests.core.test_scalarinherit/torch_np.numpy_tests.core.test_scalarinherit-1bcd67bcd0d38b25.xml (deflated 28%)
2024-12-18T00:29:00.6704379Z   adding: test/test-reports/python-pytest/test_openmp/test_openmp-e1840e1bf4b8660c.xml (deflated 28%)
2024-12-18T00:29:00.6705548Z   adding: test/test-reports/python-pytest/profiler.test_profiler/profiler.test_profiler-67e63370f0c514dd.xml (deflated 83%)
2024-12-18T00:29:00.6707005Z   adding: test/test-reports/python-pytest/torch_np.test_random/torch_np.test_random-9a7c0b59a2e1335a.xml (deflated 28%)
2024-12-18T00:29:00.6708237Z   adding: test/test-reports/python-pytest/test_functionalization/test_functionalization-81caf9082233672c.xml (deflated 28%)
2024-12-18T00:29:00.6709452Z   adding: test/test-reports/python-pytest/test_proxy_tensor/test_proxy_tensor-3c3a36a9ed884112.xml (deflated 28%)
2024-12-18T00:29:00.6710575Z   adding: test/test-reports/python-pytest/torch_np.test_basic/torch_np.test_basic-12ddd19b854a5ba2.xml (deflated 28%)
2024-12-18T00:29:00.6711657Z   adding: test/test-reports/python-pytest/test_complex/test_complex-5c01bfe91c87600a.xml (deflated 28%)
2024-12-18T00:29:00.6712777Z   adding: test/test-reports/python-pytest/test_tensorexpr_pybind/test_tensorexpr_pybind-9007a9d4e6db6fbb.xml (deflated 28%)
2024-12-18T00:29:00.6713918Z   adding: test/test-reports/python-pytest/test_type_hints/test_type_hints-900ef11ab91da81f.xml (deflated 28%)
2024-12-18T00:29:00.6715097Z   adding: test/test-reports/python-pytest/functorch.test_minifier/functorch.test_minifier-c32c2e3ceec5c824.xml (deflated 28%)
2024-12-18T00:29:00.6716262Z   adding: test/test-reports/python-pytest/test_jiterator/test_jiterator-a8928f294464ab2e.xml (deflated 29%)
2024-12-18T00:29:00.6717529Z   adding: test/test-reports/python-pytest/torch_np.numpy_tests.core.test_numeric/torch_np.numpy_tests.core.test_numeric-1cf6cbbbda554f46.xml (deflated 28%)
2024-12-18T00:29:00.6718871Z   adding: test/test-reports/python-pytest/test_per_overload_api/test_per_overload_api-c81e30afb4d12345.xml (deflated 28%)
2024-12-18T00:29:00.6720020Z   adding: test/test-reports/python-pytest/test_numpy_interop/test_numpy_interop-faa6abd7ed94dac6.xml (deflated 28%)
2024-12-18T00:29:00.6721256Z   adding: test/test-reports/python-pytest/nn.test_multihead_attention/nn.test_multihead_attention-de3cfa04ab4ff757.xml (deflated 28%)
2024-12-18T00:29:00.6722620Z   adding: test/test-reports/python-pytest/test_fx_experimental/test_fx_experimental-1a5380a714453544.xml (deflated 28%)
2024-12-18T00:29:00.6723827Z   adding: test/test-reports/python-pytest/functorch.test_logging/functorch.test_logging-c2643bf5791804dc.xml (deflated 28%)
2024-12-18T00:29:00.6725045Z   adding: test/test-reports/python-pytest/test_native_functions/test_native_functions-85f27a0f6eca18ea.xml (deflated 28%)
2024-12-18T00:29:00.6726288Z   adding: test/test-reports/python-pytest/functorch.test_control_flow/functorch.test_control_flow-313c9229b082fce1.xml (deflated 28%)
2024-12-18T00:29:00.6727582Z   adding: test/test-reports/python-pytest/torch_np.test_ufuncs_basic/torch_np.test_ufuncs_basic-01dcf8e0456199a4.xml (deflated 28%)
2024-12-18T00:29:00.6728821Z   adding: test/test-reports/python-pytest/nn.test_packed_sequence/nn.test_packed_sequence-6c1a20c093fd648b.xml (deflated 28%)
2024-12-18T00:29:00.6729962Z   adding: test/test-reports/python-pytest/test_sympy_utils/test_sympy_utils-325f71612478ed87.xml (deflated 28%)
2024-12-18T00:29:00.6731247Z   adding: test/test-reports/python-pytest/test_set_default_mobile_cpu_allocator/test_set_default_mobile_cpu_allocator-42baf49119586d35.xml (deflated 28%)
2024-12-18T00:29:00.6732650Z   adding: test/test-reports/python-pytest/test_sparse_semi_structured/test_sparse_semi_structured-161dadbfd76f5dd8.xml (deflated 28%)
2024-12-18T00:29:00.6733930Z   adding: test/test-reports/python-pytest/nn.test_parametrization/nn.test_parametrization-2850736abba774b6.xml (deflated 28%)
2024-12-18T00:29:00.6735142Z   adding: test/test-reports/python-pytest/functorch.test_vmap/functorch.test_vmap-5b4ba8e37ce25528.xml (deflated 28%)
2024-12-18T00:29:00.6736207Z   adding: test/test-reports/python-pytest/test_decomp/test_decomp-3b6572c833d83a6c.xml (deflated 28%)
2024-12-18T00:29:00.6737209Z   adding: test/test-reports/python-pytest/test_decomp/test_decomp-e18dff61d786c485.xml (deflated 28%)
2024-12-18T00:29:00.6738207Z   adding: test/test-reports/python-pytest/test_decomp/test_decomp-7b4f94e9abedb4bb.xml (deflated 28%)
2024-12-18T00:29:00.6739303Z   adding: test/test-reports/python-pytest/test_decomp/test_decomp-a4846d57044f5c2b.xml (deflated 28%)
2024-12-18T00:29:00.6740394Z   adding: test/test-reports/python-pytest/test_flop_counter/test_flop_counter-9abb0de0a29e4f3a.xml (deflated 28%)
2024-12-18T00:29:00.6741519Z   adding: test/test-reports/python-pytest/test_bundled_inputs/test_bundled_inputs-e23ca60435f1b404.xml (deflated 28%)
2024-12-18T00:29:00.6742698Z   adding: test/test-reports/python-pytest/test_numba_integration/test_numba_integration-52565337a437e79b.xml (deflated 28%)
2024-12-18T00:29:00.6743749Z   adding: test/test-reports/python-pytest/test_itt/test_itt-a355d537f59f60db.xml (deflated 28%)
2024-12-18T00:29:00.6744882Z   adding: test/test-reports/python-pytest/profiler.test_profiler_tree/profiler.test_profiler_tree-fdc10ec40bec4717.xml (deflated 28%)
2024-12-18T00:29:00.6746323Z   adding: test/test-reports/python-pytest/torch_np.numpy_tests.core.test_shape_base/torch_np.numpy_tests.core.test_shape_base-885be88711355e90.xml (deflated 27%)
2024-12-18T00:29:00.6747893Z   adding: test/test-reports/python-pytest/torch_np.numpy_tests.core.test_scalarmath/torch_np.numpy_tests.core.test_scalarmath-c9b794f7105b55ff.xml (deflated 28%)
2024-12-18T00:29:00.6749268Z   adding: test/test-reports/python-pytest/test_fx_reinplace_pass/test_fx_reinplace_pass-63762d08a760170a.xml (deflated 28%)
2024-12-18T00:29:00.6750449Z   adding: test/test-reports/python-pytest/functorch.test_dims/functorch.test_dims-58812802d55cebf5.xml (deflated 28%)
2024-12-18T00:29:00.6751552Z   adding: test/test-reports/python-pytest/test_fx_passes/test_fx_passes-8a59dc5fe463a129.xml (deflated 28%)
2024-12-18T00:29:00.6752696Z   adding: test/test-reports/python-pytest/test_segment_reductions/test_segment_reductions-b6ae19534eb2e6cc.xml (deflated 28%)
2024-12-18T00:29:00.6754077Z   adding: test/test-reports/python-pytest/torch_np.numpy_tests.core.test_multiarray/torch_np.numpy_tests.core.test_multiarray-c9ac6f4e8d459b96.xml (deflated 28%)
2024-12-18T00:29:00.6755520Z   adding: test/test-reports/python-pytest/test_legacy_vmap/test_legacy_vmap-e396b1b50395aa48.xml (deflated 28%)
2024-12-18T00:29:00.6757051Z   adding: test/test-reports/python-pytest/test_subclass/test_subclass-4deecc9ee19c6921.xml (deflated 28%)
2024-12-18T00:29:00.6758331Z   adding: test/test-reports/python-pytest/torch_np.numpy_tests.linalg.test_linalg/torch_np.numpy_tests.linalg.test_linalg-842244d61c18c318.xml (deflated 28%)
2024-12-18T00:29:00.6759584Z   adding: test/test-reports/python-pytest/test_dlpack/test_dlpack-1fb45569c8bad21e.xml (deflated 28%)
2024-12-18T00:29:00.6760642Z   adding: test/test-reports/python-pytest/nn.test_embedding/nn.test_embedding-c150d92cbc2e4fac.xml (deflated 28%)
2024-12-18T00:29:00.6762023Z   adding: test/test-reports/python-pytest/torch_np.numpy_tests.lib.test_type_check/torch_np.numpy_tests.lib.test_type_check-214cbe3c38ff5f5b.xml (deflated 27%)
2024-12-18T00:29:00.6763280Z   adding: test/test-reports/python-pytest/test_masked/test_masked-63cd66c361cdb430.xml (deflated 28%)
2024-12-18T00:29:00.6764253Z   adding: test/test-reports/python-pytest/test_jit/test_jit-2c8e2356354a076a.xml (deflated 28%)
2024-12-18T00:29:00.6765478Z   adding: test/test-reports/python-pytest/torch_np.numpy_tests.core.test_indexing/torch_np.numpy_tests.core.test_indexing-bba2e31790621ee8.xml (deflated 28%)
2024-12-18T00:29:00.6766975Z   adding: test/test-reports/python-pytest/functorch.test_vmap_registrations/functorch.test_vmap_registrations-d89307bb63baaa22.xml (deflated 28%)
2024-12-18T00:29:00.6768414Z   adding: test/test-reports/python-pytest/profiler.test_memory_profiler/profiler.test_memory_profiler-7cd7c9beae87370f.xml (deflated 28%)
2024-12-18T00:29:00.6769674Z   adding: test/test-reports/python-pytest/test_maskedtensor/test_maskedtensor-039a52ef9f3953a8.xml (deflated 28%)
2024-12-18T00:29:00.6770777Z   adding: test/test-reports/python-pytest/nn.test_dropout/nn.test_dropout-b871e5deff71590c.xml (deflated 28%)
2024-12-18T00:29:00.6771772Z   adding: test/test-reports/python-pytest/test_meta/test_meta-56625fd79a9a59d1.xml (deflated 28%)
2024-12-18T00:29:00.6772953Z   adding: test/test-reports/python-pytest/test_quantization/test_quantization-de7afac27967c00e.xml (deflated 28%)
2024-12-18T00:29:00.6774116Z   adding: test/test-reports/python-pytest/test_quantization/test_quantization-365493b71aff9d42.xml (deflated 28%)
2024-12-18T00:29:00.6809329Z ##[group]Run # Remove any previous usage logs if they exist
2024-12-18T00:29:00.6809980Z # Remove any previous usage logs if they exist
2024-12-18T00:29:00.6810502Z rm -f logs-*.zip
2024-12-18T00:29:00.6811166Z # this workflow is also run in bazel build test, but we dont generate usage reports for it
2024-12-18T00:29:00.6811916Z # so check to see if the file exists first
2024-12-18T00:29:00.6812426Z if [ -f 'usage_log.txt' ]; then
2024-12-18T00:29:00.6812955Z     zip "logs-${FILE_SUFFIX}.zip" 'usage_log.txt'
2024-12-18T00:29:00.6813474Z fi
2024-12-18T00:29:00.6814019Z if find "test/test-reports" -name "*.log" 2>/dev/null | grep -q .; then
2024-12-18T00:29:00.6814804Z     zip -r "logs-${FILE_SUFFIX}.zip" test/test-reports -i '*.log'
2024-12-18T00:29:00.6815369Z fi
2024-12-18T00:29:00.6821909Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:29:00.6822386Z env:
2024-12-18T00:29:00.6822689Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:29:00.6823138Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:29:00.6823842Z   DOCKER_CONTAINER_ID: bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:29:00.6824643Z   FILE_SUFFIX: test-default-4-5-lf.linux.4xlarge.nvidia.gpu_34566510375
2024-12-18T00:29:00.6825202Z ##[endgroup]
2024-12-18T00:29:00.6915982Z   adding: usage_log.txt (deflated 95%)
2024-12-18T00:29:00.6989876Z   adding: test/test-reports/test_nestedtensor_1.1_1fb279556bdb67aa_.log (deflated 50%)
2024-12-18T00:29:00.6990761Z   adding: test/test-reports/dynamo.test_after_aot_1.1_84b91c04d100363e_.log (deflated 50%)
2024-12-18T00:29:00.6991910Z   adding: test/test-reports/inductor.test_cpu_repro_1.6_b2a7f12a100cbcd6_.log (deflated 50%)
2024-12-18T00:29:00.6992825Z   adding: test/test-reports/dynamo.test_higher_order_ops_1.1_4ae0c3cf9da56218_.log (deflated 51%)
2024-12-18T00:29:00.6993688Z   adding: test/test-reports/dynamo.test_repros_1.1_e6be38e01799197e_.log (deflated 50%)
2024-12-18T00:29:00.6994608Z   adding: test/test-reports/inductor.test_inductor_freezing_1.1_1f69fb860e28eebd_.log (deflated 52%)
2024-12-18T00:29:00.6995506Z   adding: test/test-reports/dynamo.test_backends_1.1_1ca24bd5a3748e69_.log (deflated 50%)
2024-12-18T00:29:00.6996394Z   adding: test/test-reports/inductor.test_mmdecomp_1.1_4ac1d8787bea9e04_.log (deflated 50%)
2024-12-18T00:29:00.6997237Z   adding: test/test-reports/dynamo.test_misc_1.1_bb4590769846e7bc_.log (deflated 50%)
2024-12-18T00:29:00.6998060Z   adding: test/test-reports/dynamo.test_logging_1.1_5d3eec82fa8550b0_.log (deflated 50%)
2024-12-18T00:29:00.6998984Z   adding: test/test-reports/inductor.test_compiled_autograd_2.3_3c6cdba1e8bb43f1_.log (deflated 51%)
2024-12-18T00:29:00.6999916Z   adding: test/test-reports/inductor.test_cpu_cpp_wrapper_1.1_47b3c7d173be9bd4_.log (stored 0%)
2024-12-18T00:29:00.7000929Z   adding: test/test-reports/inductor.test_aot_inductor_arrayref_3.5_761c78e4de41f2ad_.log (deflated 52%)
2024-12-18T00:29:00.7001864Z   adding: test/test-reports/torch_np.test_binary_ufuncs_1.1_3ad1200bd6dbcf6c_.log (deflated 51%)
2024-12-18T00:29:00.7002732Z   adding: test/test-reports/test_maskedtensor_1.1_9b7e16424efdab00_.log (deflated 50%)
2024-12-18T00:29:00.7003680Z   adding: test/test-reports/export.test_export_training_ir_to_run_decomp_1.1_777563bfe24ff4a0_.log (deflated 61%)
2024-12-18T00:29:00.7004603Z   adding: test/test-reports/inductor.test_smoke_1.1_78394ba4c34709e2_.log (stored 0%)
2024-12-18T00:29:00.7005508Z   adding: test/test-reports/export.test_unflatten_training_ir_1.1_1d1025b2191ef7a5_.log (deflated 51%)
2024-12-18T00:29:00.7006577Z   adding: test/test-reports/inductor.test_config_1.1_f5f740f3c13f47ad_.log (deflated 50%)
2024-12-18T00:29:00.7007483Z   adding: test/test-reports/inductor.test_debug_trace_1.1_a6dc36c52c6d15de_.log (deflated 51%)
2024-12-18T00:29:00.7008440Z   adding: test/test-reports/inductor.test_external_callables_1.1_eb7c63899e6873f5_.log (deflated 51%)
2024-12-18T00:29:00.7009431Z   adding: test/test-reports/inductor.test_mkldnn_pattern_matcher_1.2_a30876f2770622bf_.log (deflated 52%)
2024-12-18T00:29:00.7010403Z   adding: test/test-reports/inductor.test_inductor_utils_1.1_5143e59a70fcd1a1_.log (deflated 51%)
2024-12-18T00:29:00.7011387Z   adding: test/test-reports/inductor.test_torchinductor_opinfo_1.1_ce0b4de2e239d679_.log (deflated 52%)
2024-12-18T00:29:00.7012387Z   adding: test/test-reports/inductor.test_compiled_optimizers_1.1_e8c91d041d02e2a6_.log (deflated 52%)
2024-12-18T00:29:00.7013312Z   adding: test/test-reports/dynamo.test_base_output_1.1_434c22ee80573fe6_.log (deflated 50%)
2024-12-18T00:29:00.7014245Z   adding: test/test-reports/inductor.test_cooperative_reductions_1.1_2134be1987884d0f_.log (stored 0%)
2024-12-18T00:29:00.7015152Z   adding: test/test-reports/test_import_stats_1.1_3d21c0f9fb6b5a66_.log (deflated 50%)
2024-12-18T00:29:00.7015973Z   adding: test/test-reports/test_binary_ufuncs_1.1_b37f78439ef8c1b3_.log (deflated 50%)
2024-12-18T00:29:00.7016804Z   adding: test/test-reports/inductor.test_pad_mm_1.1_706a21ae5df1fcfc_.log (stored 0%)
2024-12-18T00:29:00.7017614Z   adding: test/test-reports/nn.test_dropout_1.1_33bcdf255cbec91d_.log (deflated 49%)
2024-12-18T00:29:00.7018613Z   adding: test/test-reports/inductor.test_torchinductor_codegen_dynamic_shapes_3.5_0702f0c149918d13_.log (deflated 57%)
2024-12-18T00:29:00.7019732Z   adding: test/test-reports/inductor.test_torchinductor_dynamic_shapes_3.5_e5399db5092c7112_.log (deflated 56%)
2024-12-18T00:29:00.7020722Z   adding: test/test-reports/dynamo.test_fx_passes_pre_grad_1.1_1d30575f50927a4a_.log (deflated 51%)
2024-12-18T00:29:00.7021819Z   adding: test/test-reports/dynamo.test_cudagraphs_expandable_segments_1.1_eeb454191ffa3761_.log (deflated 50%)
2024-12-18T00:29:00.7022799Z   adding: test/test-reports/dynamo.test_modules_1.1_1cd1cafc23a509f7_.log (deflated 50%)
2024-12-18T00:29:00.7023689Z   adding: test/test-reports/inductor.test_combo_kernels_1.1_f5045828aced9592_.log (deflated 51%)
2024-12-18T00:29:00.7024595Z   adding: test/test-reports/dynamo.test_skip_non_tensor_1.1_613ce9324d608f27_.log (deflated 51%)
2024-12-18T00:29:00.7025473Z   adding: test/test-reports/functorch.test_ops_1.9_21ce33665f4dd9ef_.log (deflated 50%)
2024-12-18T00:29:00.7026279Z   adding: test/test-reports/functorch.test_ops_6.9_1c2393d29ae8dd00_.log (deflated 50%)
2024-12-18T00:29:00.7027118Z   adding: test/test-reports/functorch.test_ops_9.9_7f82ca427dc50abd_.log (deflated 49%)
2024-12-18T00:29:00.7028032Z   adding: test/test-reports/inductor.test_coordinate_descent_tuner_1.1_8bf29587b2111dcb_.log (stored 0%)
2024-12-18T00:29:00.7028933Z   adding: test/test-reports/xpu.test_conv_1.1_c94b18558b8e8aef_.log (deflated 48%)
2024-12-18T00:29:00.7029770Z   adding: test/test-reports/inductor.test_multi_kernel_1.1_24353616c70741fb_.log (stored 0%)
2024-12-18T00:29:00.7030624Z   adding: test/test-reports/test_ops_fwd_gradients_2.3_909d12ed3d04a0ef_.log (deflated 50%)
2024-12-18T00:29:00.7031561Z   adding: test/test-reports/dynamo.test_backward_higher_order_ops_1.1_85467b1388af1957_.log (deflated 52%)
2024-12-18T00:29:00.7032485Z   adding: test/test-reports/inductor.test_inplacing_pass_1.1_89b1206b840529a2_.log (stored 0%)
2024-12-18T00:29:00.7033355Z   adding: test/test-reports/dynamo.test_sources_1.1_26b30c8446ad81dc_.log (deflated 50%)
2024-12-18T00:29:00.7034212Z   adding: test/test-reports/dynamo.test_model_output_1.1_348adc2038d47bcb_.log (deflated 50%)
2024-12-18T00:29:00.7035127Z   adding: test/test-reports/inductor.test_memory_planning_1.1_2d58cc95e3534a2e_.log (stored 0%)
2024-12-18T00:29:00.7036073Z   adding: test/test-reports/higher_order_ops.test_with_effects_1.1_0ffc1c7dcf4725d4_.log (deflated 52%)
2024-12-18T00:29:00.7037104Z   adding: test/test-reports/export.test_passes_1.1_97a1e8dae0e2cd4a_.log (deflated 50%)
2024-12-18T00:29:00.7038010Z   adding: test/test-reports/dynamo.test_structured_trace_1.1_4847ecd074c0bcdc_.log (deflated 51%)
2024-12-18T00:29:00.7039070Z   adding: test/test-reports/inductor.test_torchinductor_codegen_config_overrides_1.1_adf57940164e45d5_.log (deflated 54%)
2024-12-18T00:29:00.7062556Z   adding: test/test-reports/dynamo.test_decorators_1.1_6967fe0dcc80b51a_.log (deflated 50%)
2024-12-18T00:29:00.7063491Z   adding: test/test-reports/lazy.test_ts_opinfo_1.1_c8079071021243d8_.log (deflated 50%)
2024-12-18T00:29:00.7064331Z   adding: test/test-reports/inductor.test_fused_attention_1.1_f3043d6260755358_.log (deflated 51%)
2024-12-18T00:29:00.7065273Z   adding: test/test-reports/inductor.test_unbacked_symints_1.1_8c9abebc8443ead9_.log (stored 0%)
2024-12-18T00:29:00.7066072Z   adding: test/test-reports/test_ops_jit_2.2_361db35190804d98_.log (deflated 49%)
2024-12-18T00:29:00.7066836Z   adding: test/test-reports/test_ops_3.12_95cee687f975e8f5_.log (deflated 48%)
2024-12-18T00:29:00.7067563Z   adding: test/test-reports/test_ops_9.12_9d2ad8f1115b0bd8_.log (deflated 48%)
2024-12-18T00:29:00.7068284Z   adding: test/test-reports/test_ops_12.12_d9e0f38aa0c70500_.log (deflated 48%)
2024-12-18T00:29:00.7069027Z   adding: test/test-reports/lazy.test_bindings_1.1_4ec41967e7f9b581_.log (stored 0%)
2024-12-18T00:29:00.7069831Z   adding: test/test-reports/test_expanded_weights_1.1_04f60c98b358339b_.log (deflated 50%)
2024-12-18T00:29:00.7070690Z   adding: test/test-reports/test_compile_benchmark_util_1.1_d2f3dacfc2bb6f01_.log (deflated 51%)
2024-12-18T00:29:00.7071689Z   adding: test/test-reports/torch_np.numpy_tests.core.test_scalarinherit_1.1_6bb2c542ade3ab6b_.log (deflated 53%)
2024-12-18T00:29:00.7072594Z   adding: test/test-reports/test_openmp_1.1_f74cc09569b82184_.log (deflated 49%)
2024-12-18T00:29:00.7073405Z   adding: test/test-reports/profiler.test_profiler_1.1_a85b02a600b8bbda_.log (deflated 78%)
2024-12-18T00:29:00.7074481Z   adding: test/test-reports/torch_np.test_random_1.1_21b75ccc83ccc6d0_.log (deflated 50%)
2024-12-18T00:29:00.7075321Z   adding: test/test-reports/test_functionalization_1.1_35e3108cd05a4404_.log (deflated 50%)
2024-12-18T00:29:00.7076160Z   adding: test/test-reports/test_proxy_tensor_1.1_fb2a724e393146ce_.log (deflated 49%)
2024-12-18T00:29:00.7076955Z   adding: test/test-reports/torch_np.test_basic_1.1_c4765e6f4b8081e7_.log (deflated 50%)
2024-12-18T00:29:00.7077742Z   adding: test/test-reports/test_complex_1.1_ec70f0b8df83c7fe_.log (deflated 49%)
2024-12-18T00:29:00.7078549Z   adding: test/test-reports/test_tensorexpr_pybind_1.1_9e840ed887036c2b_.log (deflated 50%)
2024-12-18T00:29:00.7079344Z   adding: test/test-reports/test_type_hints_1.1_79f5ebb65c74b67c_.log (deflated 49%)
2024-12-18T00:29:00.7080165Z   adding: test/test-reports/functorch.test_minifier_1.1_529ba6a7b72f6cb7_.log (deflated 51%)
2024-12-18T00:29:00.7080994Z   adding: test/test-reports/test_jiterator_1.1_0e0c4f62558b2388_.log (deflated 49%)
2024-12-18T00:29:00.7081871Z   adding: test/test-reports/torch_np.numpy_tests.core.test_numeric_1.1_bb2c00386a1e088f_.log (deflated 52%)
2024-12-18T00:29:00.7082794Z   adding: test/test-reports/test_per_overload_api_1.1_4a8e5aa3dd62b8c1_.log (deflated 50%)
2024-12-18T00:29:00.7083632Z   adding: test/test-reports/test_numpy_interop_1.1_9412e67d74e5ff29_.log (deflated 50%)
2024-12-18T00:29:00.7084516Z   adding: test/test-reports/nn.test_multihead_attention_1.1_aeee47db7d7af929_.log (deflated 51%)
2024-12-18T00:29:00.7085435Z   adding: test/test-reports/test_fx_experimental_1.1_992e483190b610c2_.log (deflated 50%)
2024-12-18T00:29:00.7086287Z   adding: test/test-reports/functorch.test_logging_1.1_a7d0910b6154f487_.log (deflated 50%)
2024-12-18T00:29:00.7087145Z   adding: test/test-reports/test_native_functions_1.1_4e59147fdec495b6_.log (deflated 50%)
2024-12-18T00:29:00.7088016Z   adding: test/test-reports/functorch.test_control_flow_1.1_ce36eeadbf283890_.log (deflated 51%)
2024-12-18T00:29:00.7089038Z   adding: test/test-reports/torch_np.test_ufuncs_basic_1.1_eccfdc711691a18b_.log (deflated 51%)
2024-12-18T00:29:00.7089928Z   adding: test/test-reports/nn.test_packed_sequence_1.1_9e1c8758e81ea595_.log (deflated 50%)
2024-12-18T00:29:00.7090734Z   adding: test/test-reports/test_sympy_utils_1.1_d3217466dd968a99_.log (deflated 49%)
2024-12-18T00:29:00.7091612Z   adding: test/test-reports/test_set_default_mobile_cpu_allocator_1.1_3f5557bf0bdfbcf0_.log (deflated 52%)
2024-12-18T00:29:00.7092537Z   adding: test/test-reports/test_sparse_semi_structured_1.1_72be59e548575cf0_.log (deflated 51%)
2024-12-18T00:29:00.7093407Z   adding: test/test-reports/nn.test_parametrization_1.1_b959132a85ff94dc_.log (deflated 50%)
2024-12-18T00:29:00.7094241Z   adding: test/test-reports/functorch.test_vmap_1.1_d9636d89e61e05c3_.log (deflated 50%)
2024-12-18T00:29:00.7095050Z   adding: test/test-reports/test_decomp_6.25_1ebaafdcfacd8127_.log (deflated 48%)
2024-12-18T00:29:00.7095846Z   adding: test/test-reports/test_decomp_10.25_fb9d2d25903ef2b5_.log (deflated 48%)
2024-12-18T00:29:00.7096628Z   adding: test/test-reports/test_decomp_16.25_824c7a71ec90e0c7_.log (deflated 48%)
2024-12-18T00:29:00.7097400Z   adding: test/test-reports/test_decomp_20.25_b5d503e505780d18_.log (deflated 48%)
2024-12-18T00:29:00.7098190Z   adding: test/test-reports/test_flop_counter_1.1_b9886bb64d487906_.log (deflated 50%)
2024-12-18T00:29:00.7098987Z   adding: test/test-reports/test_bundled_inputs_1.1_7217424a2b3931d7_.log (deflated 50%)
2024-12-18T00:29:00.7099832Z   adding: test/test-reports/test_numba_integration_1.1_34369798f708ebd5_.log (deflated 50%)
2024-12-18T00:29:00.7100720Z   adding: test/test-reports/test_itt_1.1_8625eb74db9b4d12_.log (deflated 48%)
2024-12-18T00:29:00.7101532Z   adding: test/test-reports/profiler.test_profiler_tree_1.1_9717f2de349cbfb2_.log (deflated 52%)
2024-12-18T00:29:00.7102529Z   adding: test/test-reports/torch_np.numpy_tests.core.test_shape_base_1.1_cecd0720aac2fab8_.log (deflated 53%)
2024-12-18T00:29:00.7103713Z   adding: test/test-reports/torch_np.numpy_tests.core.test_scalarmath_1.1_b650df27864ed0be_.log (deflated 53%)
2024-12-18T00:29:00.7105312Z   adding: test/test-reports/test_fx_reinplace_pass_1.1_d14299b40f6c202b_.log (deflated 50%)
2024-12-18T00:29:00.7106203Z   adding: test/test-reports/functorch.test_dims_1.1_d453a4526ae94521_.log (deflated 50%)
2024-12-18T00:29:00.7106988Z   adding: test/test-reports/test_fx_passes_1.1_f24f3dac5e545cd5_.log (deflated 61%)
2024-12-18T00:29:00.7107821Z   adding: test/test-reports/test_segment_reductions_1.1_a22ef304d6256ac6_.log (deflated 50%)
2024-12-18T00:29:00.7108775Z   adding: test/test-reports/torch_np.numpy_tests.core.test_multiarray_1.1_683e820b8d340505_.log (deflated 53%)
2024-12-18T00:29:00.7109691Z   adding: test/test-reports/test_legacy_vmap_1.1_d392a7e6337f47b3_.log (deflated 49%)
2024-12-18T00:29:00.7110483Z   adding: test/test-reports/test_subclass_1.1_c8dddc02e708c97d_.log (deflated 49%)
2024-12-18T00:29:00.7111383Z   adding: test/test-reports/torch_np.numpy_tests.linalg.test_linalg_1.1_e58e9220f8d44654_.log (deflated 53%)
2024-12-18T00:29:00.7112254Z   adding: test/test-reports/test_dlpack_1.1_a916bc40844cbb0d_.log (deflated 49%)
2024-12-18T00:29:00.7113019Z   adding: test/test-reports/nn.test_embedding_1.1_52b141fa94f1478d_.log (deflated 50%)
2024-12-18T00:29:00.7113936Z   adding: test/test-reports/torch_np.numpy_tests.lib.test_type_check_1.1_b40094b08dd110f7_.log (deflated 53%)
2024-12-18T00:29:00.7114830Z   adding: test/test-reports/test_masked_1.1_c7c37a0b32116e63_.log (deflated 49%)
2024-12-18T00:29:00.7115588Z   adding: test/test-reports/test_jit_1.1_9783859dc4a89359_.log (deflated 48%)
2024-12-18T00:29:00.7116445Z   adding: test/test-reports/torch_np.numpy_tests.core.test_indexing_1.1_ae221fccae1f1852_.log (deflated 52%)
2024-12-18T00:29:00.7117455Z   adding: test/test-reports/functorch.test_vmap_registrations_1.1_8f8c05f384e47a9f_.log (deflated 52%)
2024-12-18T00:29:00.7118563Z   adding: test/test-reports/profiler.test_memory_profiler_1.1_432ba14f905db0e3_.log (deflated 52%)
2024-12-18T00:29:00.7119433Z   adding: test/test-reports/test_meta_1.4_a76203b740b9b4dd_.log (deflated 49%)
2024-12-18T00:29:00.7120218Z   adding: test/test-reports/test_quantization_1.3_62bce2eb8a5ca344_.log (deflated 62%)
2024-12-18T00:29:00.7121041Z   adding: test/test-reports/test_quantization_2.3_5f58748cc8afc1f0_.log (deflated 62%)
2024-12-18T00:29:00.7121864Z   adding: test/test-reports/optim.test_lrscheduler_1.1_db615d9d32802dd8_.log (deflated 7%)
2024-12-18T00:29:00.7122708Z   adding: test/test-reports/dynamo.test_after_aot_1.1_415afac3d11a3baa_.log (deflated 54%)
2024-12-18T00:29:00.7123582Z   adding: test/test-reports/inductor.test_cpu_repro_1.6_3h76t8aq_toprint.log (deflated 92%)
2024-12-18T00:29:00.7124458Z   adding: test/test-reports/test_nestedtensor_1.1_e97c0bc164da9cc7_.log (deflated 94%)
2024-12-18T00:29:00.7162365Z ##[group]Run # Remove any previous debugging artifacts if they exist
2024-12-18T00:29:00.7163104Z # Remove any previous debugging artifacts if they exist
2024-12-18T00:29:00.7163679Z rm -f debug-*.zip
2024-12-18T00:29:00.7164092Z if [ -d 'test/debug' ]; then
2024-12-18T00:29:00.7164589Z   zip -r "debug-${FILE_SUFFIX}.zip" test/debug
2024-12-18T00:29:00.7165081Z fi
2024-12-18T00:29:00.7171865Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:29:00.7172389Z env:
2024-12-18T00:29:00.7172698Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:29:00.7173182Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:29:00.7173918Z   DOCKER_CONTAINER_ID: bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:29:00.7174773Z   FILE_SUFFIX: test-default-4-5-lf.linux.4xlarge.nvidia.gpu_34566510375
2024-12-18T00:29:00.7175371Z ##[endgroup]
2024-12-18T00:29:00.7276574Z ##[group]Run seemethere/upload-artifact-s3@v5
2024-12-18T00:29:00.7277023Z with:
2024-12-18T00:29:00.7277508Z   s3-bucket: gha-artifacts
2024-12-18T00:29:00.7277942Z   s3-prefix: pytorch/pytorch/12383255654/1/artifact

2024-12-18T00:29:00.7278417Z   retention-days: 14
2024-12-18T00:29:00.7278754Z   if-no-files-found: warn
2024-12-18T00:29:00.7279122Z   path: test-jsons-*.zip
2024-12-18T00:29:00.7279472Z   name: artifact
2024-12-18T00:29:00.7279791Z   region: us-east-1
2024-12-18T00:29:00.7280114Z env:
2024-12-18T00:29:00.7280388Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:29:00.7280836Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:29:00.7281536Z   DOCKER_CONTAINER_ID: bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:29:00.7282162Z ##[endgroup]
2024-12-18T00:29:01.1887699Z NOTE: s3-prefix specified, ignoring name parameter
2024-12-18T00:29:01.1888834Z With the provided path, there will be 1 file uploaded
2024-12-18T00:29:01.1889856Z Uploading to s3 prefix: pytorch/pytorch/12383255654/1/artifact
2024-12-18T00:29:01.1947505Z Starting upload of test-jsons-test-default-4-5-lf.linux.4xlarge.nvidia.gpu_34566510375.zip
2024-12-18T00:29:01.3882259Z Finished upload of test-jsons-test-default-4-5-lf.linux.4xlarge.nvidia.gpu_34566510375.zip
2024-12-18T00:29:01.4085665Z ##[group]Run seemethere/upload-artifact-s3@v5
2024-12-18T00:29:01.4086145Z with:
2024-12-18T00:29:01.4086452Z   s3-bucket: gha-artifacts
2024-12-18T00:29:01.4086920Z   s3-prefix: pytorch/pytorch/12383255654/1/artifact

2024-12-18T00:29:01.4087421Z   retention-days: 14
2024-12-18T00:29:01.4087800Z   if-no-files-found: error
2024-12-18T00:29:01.4088205Z   path: test-reports-*.zip
2024-12-18T00:29:01.4088575Z   name: artifact
2024-12-18T00:29:01.4088917Z   region: us-east-1
2024-12-18T00:29:01.4089261Z env:
2024-12-18T00:29:01.4089568Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:29:01.4090050Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:29:01.4090803Z   DOCKER_CONTAINER_ID: bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:29:01.4091485Z ##[endgroup]
2024-12-18T00:29:01.8482694Z NOTE: s3-prefix specified, ignoring name parameter
2024-12-18T00:29:01.8484419Z With the provided path, there will be 1 file uploaded
2024-12-18T00:29:01.8485725Z Uploading to s3 prefix: pytorch/pytorch/12383255654/1/artifact
2024-12-18T00:29:01.8543615Z Starting upload of test-reports-test-default-4-5-lf.linux.4xlarge.nvidia.gpu_34566510375.zip
2024-12-18T00:29:02.0112790Z Finished upload of test-reports-test-default-4-5-lf.linux.4xlarge.nvidia.gpu_34566510375.zip
2024-12-18T00:29:02.0316352Z ##[group]Run seemethere/upload-artifact-s3@v5
2024-12-18T00:29:02.0316827Z with:
2024-12-18T00:29:02.0317133Z   s3-bucket: gha-artifacts
2024-12-18T00:29:02.0317604Z   s3-prefix: pytorch/pytorch/12383255654/1/artifact

2024-12-18T00:29:02.0318101Z   retention-days: 14
2024-12-18T00:29:02.0318478Z   if-no-files-found: ignore
2024-12-18T00:29:02.0318884Z   path: logs-*.zip
2024-12-18T00:29:02.0319229Z   name: artifact
2024-12-18T00:29:02.0319569Z   region: us-east-1
2024-12-18T00:29:02.0319889Z env:
2024-12-18T00:29:02.0320215Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:29:02.0320734Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:29:02.0321497Z   DOCKER_CONTAINER_ID: bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:29:02.0322174Z ##[endgroup]
2024-12-18T00:29:02.4659070Z NOTE: s3-prefix specified, ignoring name parameter
2024-12-18T00:29:02.4659669Z With the provided path, there will be 1 file uploaded
2024-12-18T00:29:02.4660258Z Uploading to s3 prefix: pytorch/pytorch/12383255654/1/artifact
2024-12-18T00:29:02.4715227Z Starting upload of logs-test-default-4-5-lf.linux.4xlarge.nvidia.gpu_34566510375.zip
2024-12-18T00:29:02.6790599Z Finished upload of logs-test-default-4-5-lf.linux.4xlarge.nvidia.gpu_34566510375.zip
2024-12-18T00:29:02.7100426Z ##[group]Run seemethere/upload-artifact-s3@v5
2024-12-18T00:29:02.7100906Z with:
2024-12-18T00:29:02.7101200Z   s3-bucket: gha-artifacts
2024-12-18T00:29:02.7101638Z   s3-prefix: pytorch/pytorch/12383255654/1/artifact

2024-12-18T00:29:02.7102364Z   retention-days: 14
2024-12-18T00:29:02.7102718Z   if-no-files-found: ignore
2024-12-18T00:29:02.7103104Z   path: debug-*.zip
2024-12-18T00:29:02.7103415Z   name: artifact
2024-12-18T00:29:02.7103733Z   region: us-east-1
2024-12-18T00:29:02.7104053Z env:
2024-12-18T00:29:02.7104352Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:29:02.7104802Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:29:02.7105485Z   DOCKER_CONTAINER_ID: bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:29:02.7106115Z ##[endgroup]
2024-12-18T00:29:03.1306920Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded.
2024-12-18T00:29:03.1529474Z ##[group]Run # shellcheck disable=SC2156
2024-12-18T00:29:03.1530049Z # shellcheck disable=SC2156
2024-12-18T00:29:03.1530796Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \;
2024-12-18T00:29:03.1538670Z shell: /usr/bin/bash -e {0}
2024-12-18T00:29:03.1539052Z env:
2024-12-18T00:29:03.1539358Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:29:03.1539795Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:29:03.1540501Z   DOCKER_CONTAINER_ID: bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:29:03.1541134Z ##[endgroup]
2024-12-18T00:29:03.4458459Z ##[group]Run seemethere/upload-artifact-s3@v5
2024-12-18T00:29:03.4458978Z with:
2024-12-18T00:29:03.4459409Z   name: coredumps-default-4-5-lf.linux.4xlarge.nvidia.gpu
2024-12-18T00:29:03.4459942Z   retention-days: 14
2024-12-18T00:29:03.4460312Z   if-no-files-found: ignore
2024-12-18T00:29:03.4460696Z   path: ./**/core.[1-9]*
2024-12-18T00:29:03.4461049Z   s3-bucket: gha-artifacts
2024-12-18T00:29:03.4461420Z   region: us-east-1
2024-12-18T00:29:03.4461746Z env:
2024-12-18T00:29:03.4462045Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:29:03.4462492Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:29:03.4463201Z   DOCKER_CONTAINER_ID: bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:29:03.4463830Z ##[endgroup]
2024-12-18T00:29:15.9171564Z No files were found with the provided path: ./**/core.[1-9]*. No artifacts will be uploaded.
2024-12-18T00:29:15.9434172Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@release/2.6
2024-12-18T00:29:15.9434868Z with:
2024-12-18T00:29:15.9435172Z env:
2024-12-18T00:29:15.9435462Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:29:15.9435956Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:29:15.9436725Z   DOCKER_CONTAINER_ID: bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:29:15.9437405Z ##[endgroup]
2024-12-18T00:29:15.9468970Z ##[group]Run set -eou pipefail
2024-12-18T00:29:15.9469434Z set -eou pipefail
2024-12-18T00:29:15.9469831Z 
2024-12-18T00:29:15.9470333Z echo "Holding runner for 2 hours until all ssh sessions have logged out"
2024-12-18T00:29:15.9470993Z for _ in $(seq 1440); do
2024-12-18T00:29:15.9471477Z     # Break if no ssh session exists anymore
2024-12-18T00:29:15.9471984Z     if [ "$(who)" = "" ]; then
2024-12-18T00:29:15.9472414Z       break
2024-12-18T00:29:15.9472804Z     fi
2024-12-18T00:29:15.9473146Z     echo "."
2024-12-18T00:29:15.9473490Z     sleep 5
2024-12-18T00:29:15.9473843Z done
2024-12-18T00:29:15.9481224Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:29:15.9481762Z env:
2024-12-18T00:29:15.9482073Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:29:15.9482542Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:29:15.9483306Z   DOCKER_CONTAINER_ID: bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:29:15.9483973Z ##[endgroup]
2024-12-18T00:29:15.9524699Z Holding runner for 2 hours until all ssh sessions have logged out
2024-12-18T00:29:15.9577500Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty
2024-12-18T00:29:15.9578520Z # ignore expansion of "docker ps -q" since it could be empty
2024-12-18T00:29:15.9579128Z # shellcheck disable=SC2046
2024-12-18T00:29:15.9579626Z docker stop $(docker ps -q) || true
2024-12-18T00:29:15.9580108Z # Prune all of the docker images
2024-12-18T00:29:15.9580583Z docker system prune -af
2024-12-18T00:29:15.9587382Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:29:15.9587914Z env:
2024-12-18T00:29:15.9588228Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:29:15.9588715Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:29:15.9589460Z   DOCKER_CONTAINER_ID: bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:29:15.9590141Z ##[endgroup]
2024-12-18T00:29:16.5494301Z bc82ba0d0766
2024-12-18T00:29:17.0934876Z Deleted Containers:
2024-12-18T00:29:17.0935452Z bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:29:17.0935912Z 
2024-12-18T00:29:23.8673517Z Deleted Images:
2024-12-18T00:29:23.8674562Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda11.8-cudnn9-py3-gcc9:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:29:23.8676236Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda11.8-cudnn9-py3-gcc9@sha256:52918bcdb0e370d1b9413099049464295e6c36e0a09cff6cff645b519e6da502
2024-12-18T00:29:23.8677565Z deleted: sha256:166dd14a00627fbd0d4e062a733b69b733b63b1ac12ec3bd5285db8a8befaaf5
2024-12-18T00:29:23.8678377Z deleted: sha256:2e828a4f851a71a08b9f06842643025da951b3d1a26bc40be945b5dc00f5015f
2024-12-18T00:29:23.8679188Z deleted: sha256:d27246a7406fc9214ce9db75df344bdd8e0a31300352beaf8ee0e0668a1ace5b
2024-12-18T00:29:23.8679988Z deleted: sha256:68c9fa6063c3f2de81e86b8de02d9c520f91cebed9343aecd84d4621681e108b
2024-12-18T00:29:23.8680813Z deleted: sha256:7fba561e060d45fd930ced565d615e1e1f5b5e1266212caaddcbdce3b6ce2157
2024-12-18T00:29:23.8681641Z deleted: sha256:5b5728232cece21786a91a2b7109215ddacbea370a452a5725759be3f9782f36
2024-12-18T00:29:23.8682431Z deleted: sha256:dc257cb01440638b647e8f88d00e791443a113161d0d4f469015690bab702c18
2024-12-18T00:29:23.8683597Z deleted: sha256:3ee1ba287c278eaf901c09c7e521f0a405bbb9fb8062aa51674fb9ea3ab18789
2024-12-18T00:29:23.8684451Z deleted: sha256:2d66661697c95587c70e4f77dc01731d10271a2a2d5ae52b240971a0554e6d0e
2024-12-18T00:29:23.8685227Z deleted: sha256:eaa304b04f52287b7bdefe4e276ed9444a9f2924aab757a4112d857162d00aae
2024-12-18T00:29:23.8686032Z deleted: sha256:4b999f756c8d5d7c8444b89e5466899b4bbd4f3adec20d788c443754a4cb2cf6
2024-12-18T00:29:23.8686841Z deleted: sha256:031bf045cac35b9a41c06ca4b85ca3419cf104dcaef931590111a4cbc99225d5
2024-12-18T00:29:23.8687647Z deleted: sha256:4a6da4e6593178794969f47a35ec4c667bd2a620051de682f4f6476200528ad7
2024-12-18T00:29:23.8688457Z deleted: sha256:d49018d0fd9477af622a59aae4a080650d82601c3ff10f5e413d54b61605cbc7
2024-12-18T00:29:23.8689275Z deleted: sha256:eaeb72d8e211a811359bbae6cdb944e506296e3593e02a7845d1de2b020db64d
2024-12-18T00:29:23.8690062Z deleted: sha256:4443a93278f4af70ebbc86c00611e1229086bcd73ba6f46cfbac959f5a3ea13e
2024-12-18T00:29:23.8690870Z deleted: sha256:7da4d3af5a970120b30198ce7c0d5758fd4180887250d2e1d20b1bb19a7ac558
2024-12-18T00:29:23.8691677Z deleted: sha256:51d1e0cf0c3b813663526e6d529bfb7f0374c2474f5a9581ccfd66f6dd722384
2024-12-18T00:29:23.8692490Z deleted: sha256:6d152e7f1f9932d4367ae21fbdcaf7e300d258e862c3c3104defca22e1f67f82
2024-12-18T00:29:23.8693302Z deleted: sha256:5f3d462f5b23f997262b6a535998f846bc071e1cbfb2039b507881fb8d873078
2024-12-18T00:29:23.8694101Z deleted: sha256:b5aa4897eb3166e0b560548c1ccbf716422a3b134bc63aa4da378db45a578506
2024-12-18T00:29:23.8694891Z deleted: sha256:19e8d1b6e7033c3cf97c2220cc96c9d4860bc5a09ad25b706a7260176331e59b
2024-12-18T00:29:23.8695697Z deleted: sha256:f82be94fab4a78f872875e44a2a54d01d6b7c7c9a73ad193593549037b0c9c6c
2024-12-18T00:29:23.8696494Z deleted: sha256:45e1395581d647e78b6fae987a785c08acea4b6176c97188b5a5010e9004d947
2024-12-18T00:29:23.8697539Z deleted: sha256:6a116d37e354cd470a6dee7600017fd2c240860da82a19939bd1451416af0972
2024-12-18T00:29:23.8698333Z deleted: sha256:96d8d1f880e7957a35c4060d1ae56eaa05c1e73ff5e7128cc5b42531a996ffeb
2024-12-18T00:29:23.8699142Z deleted: sha256:a186beea437cb709b244be99550467206b5bdcb190e032c091f15a6a065ddc36
2024-12-18T00:29:23.8699953Z deleted: sha256:e5f8bcff21a8fbb2d507150a82a1b26ebcec9caf9ee8fa7dce844574ef8da2ad
2024-12-18T00:29:23.8700789Z deleted: sha256:13091955acb9200fc139971ba2434c90657de11ff38ac954e35f3461fa4a6b8a
2024-12-18T00:29:23.8701588Z deleted: sha256:be10df8394bb253584f3f2f4c84a28bd53744e8c6892f1efcb4b12b67abe23da
2024-12-18T00:29:23.8702413Z deleted: sha256:ca58fcd63e3576eddbb8aaef07131e18631c53e4e9b6e8d9dbec5b8ddfa7726a
2024-12-18T00:29:23.8703280Z deleted: sha256:57c7d561a44e019b14a0f4aae3354ec1734b088b539cab6fb0e8ecca850ee714
2024-12-18T00:29:23.8704103Z deleted: sha256:a960411fa30719c90510a13403dcde638fbee3cbbb4ab71f14e52f40e9dd4533
2024-12-18T00:29:23.8704922Z deleted: sha256:8a2ef497a8ab2819802ad459d2dafe5195a85d11b38ef6d6d4d4fe872d9c6b6b
2024-12-18T00:29:23.8705734Z deleted: sha256:cbf589ae40cc4496ffa854c9108d58905a2ea5ac3162669b3b4606287b751d28
2024-12-18T00:29:23.8706581Z deleted: sha256:88c378f8d5104ea7a03bf49a1a7db4df53518519236345cf29bc2df76377d0ac
2024-12-18T00:29:23.8707399Z deleted: sha256:db2a844a68747daa51bb2b28c083df270c19bfbcb7e038723a1db1bacf20462e
2024-12-18T00:29:23.8708209Z deleted: sha256:f548fd4a27a545794a88afc9f9f3460001efb98677ae40f9737387bffedd901d
2024-12-18T00:29:23.8709003Z deleted: sha256:42f4cf4d61dad97d4c5f3bd5cb9374fe260e5166e36f4ae2d00a9c59127abb3a
2024-12-18T00:29:23.8709832Z deleted: sha256:1e465635bd263f73940e977a6d9ab8b3beceabc5eaa9d08c65a28aafdf72abf0
2024-12-18T00:29:23.8710634Z deleted: sha256:b890305c75102c7bd0a645b98b0e1893d45433319a1394c457afb7ffc3ac1070
2024-12-18T00:29:23.8711443Z deleted: sha256:c9d4902893199761be10cecc8c1de9ce1242b5df3c161bc452e5ffcf2d3bff38
2024-12-18T00:29:23.8712315Z deleted: sha256:254c14be940e16bbbe4d6da795ac3a987a11fde9842d614f31c1caae910c7263
2024-12-18T00:29:23.8713152Z deleted: sha256:137abe9e7f1c1726800d1ae709a40b92e48267f52dd7fa7b966be15345a94850
2024-12-18T00:29:23.8714060Z deleted: sha256:771d7f9e8bf6f532b16c3daa3a9167d4030f919eec29b18d99387ad1d1a277cb
2024-12-18T00:29:23.8714909Z deleted: sha256:22ee16d76a83cee720de0aafa52532ff1f3335a9048ff43877cee2aa6a370f5f
2024-12-18T00:29:23.8715746Z deleted: sha256:dbbad5d1e6d1785ee41424b56457a16a1d882ff1c09f41486b443b8c1e7c7eb4
2024-12-18T00:29:23.8716538Z deleted: sha256:df9a3657ce5f83f7ab775078ff74a472438fc5c21e1e0de53cc66509788e12bc
2024-12-18T00:29:23.8717353Z deleted: sha256:245eebe495c94ddc69ab83759089101d2edfdbf90474a3cb772e7bf1cce893bd
2024-12-18T00:29:23.8718165Z deleted: sha256:235e5b71d4fbb1eaf808e6fd789604752f653c1176b8acb1ba97604f35418396
2024-12-18T00:29:23.8718967Z deleted: sha256:c96d511cee1be7af8a8fedcab42cac5233cf66be05d188a2ba32ba4db1d2f715
2024-12-18T00:29:23.8719795Z deleted: sha256:704760c42e98a22e0f5ce40f10bdc3baec3e4ca679c2b046e90e6e12228a7164
2024-12-18T00:29:23.8720630Z deleted: sha256:78ec6b9f299f8114edc65d21c0c2e730f8423fcc496b819fe25df22af7477bd6
2024-12-18T00:29:23.8721446Z deleted: sha256:3d2201aa2c2a2db1e240c872ac8b84d4c92eed331c5c0053eaea4a8d292dd29a
2024-12-18T00:29:23.8722260Z deleted: sha256:2f8151f506d01c5be81b7547d7c20a36a2f30f6713adecaa91adb633fab9d809
2024-12-18T00:29:23.8723038Z deleted: sha256:d1f62ced0636553b623466ced7568917bb2b453997168ceb2635926f5c069ae6
2024-12-18T00:29:23.8723843Z deleted: sha256:bcb018d693dd3d8346bc43a253a42de37aad6ae11f42ee748dd9fdf1d3b259fc
2024-12-18T00:29:23.8724658Z deleted: sha256:40f224dcd4345d71537636d5c3bdb9c0659430771d9ac90c9e7cf7da30fabdd3
2024-12-18T00:29:23.8725452Z deleted: sha256:113e5e34c2859806f96efe4d47aa5e0d438e3f72211b7d539de8750bbfed7a98
2024-12-18T00:29:23.8726247Z deleted: sha256:a4786d6f71e2eec542ec8c4ff41191481de085b7e1b4e0139995017b6b7d6477
2024-12-18T00:29:23.8727054Z deleted: sha256:84faffca53886fb81b780b885baa8b6b4a4c16795bf93c9eed6f165c8d333545
2024-12-18T00:29:23.8727960Z deleted: sha256:22f20f90960f1663da6dbde7ea9b18026e0e1b03006890d56f64fc084a7550e3
2024-12-18T00:29:23.8728752Z deleted: sha256:d53c4a66cd75e088673985522b5ba099599960ac06350e59cfd330572327bff2
2024-12-18T00:29:23.8729557Z deleted: sha256:e95f4ec4da5fef7e54c22d270b51d9077a8c577a82bf0304e200fce309551084
2024-12-18T00:29:23.8730365Z deleted: sha256:ddbe476a0432522a73e2b052342ebc6f8610f7437c076ff6bf7e4501dc79efbc
2024-12-18T00:29:23.8731173Z deleted: sha256:ad7883a4c2954aebf555ea86e018fee1cc12d159b9e4d149263eb92c7cd21708
2024-12-18T00:29:23.8732002Z deleted: sha256:656ce67e45b8dab0cf77d1d21cd380f5ddfa64bfd486ebaa47b3af7c9b9df7b5
2024-12-18T00:29:23.8732805Z deleted: sha256:ae5754644efe96c6b01bbe838a7db9aac49333bf618c0a05160cdd0dd4b38fe8
2024-12-18T00:29:23.8733627Z deleted: sha256:23058ae084a55e5fd11db1aabe073f1886a1047be70eeb78dada3e6d4949c4d7
2024-12-18T00:29:23.8734445Z deleted: sha256:55c98b096fa43eb44df581de08d34a280f6eb359a04b1562fedccca5d56748e3
2024-12-18T00:29:23.8735271Z deleted: sha256:4a1d549deb2a6a9e8c52225d513aefeffbe0097e1eeb8217ca34963724db0b53
2024-12-18T00:29:23.8736091Z deleted: sha256:89e3b1c20a2d617b0ed103dc78296d410c1611d2044d8426fcc757b64c3113fe
2024-12-18T00:29:23.8736891Z deleted: sha256:89edf8c906678c217b9a88160e1561991f53909c3fd27a4a5e1f0ca0f7ff7888
2024-12-18T00:29:23.8737692Z deleted: sha256:d5ba67f8f9b0c2b6da06d2d5d9d5fedc9f17cbe1a5e13a1a4033a4619f4528ba
2024-12-18T00:29:23.8738506Z deleted: sha256:5d61311e1a293c0c9642e34871719525dfeec7028e4b45e08344a469e3fe24bf
2024-12-18T00:29:23.8739306Z deleted: sha256:b89bb70f745a94c0edd5e974aee294e160735f76fd666a1a06a0b9b1be3caf63
2024-12-18T00:29:23.8740224Z deleted: sha256:9e5477f1f21a38c3dfe21a56a7d77d1b1a42453aed3e11729afcbb9d5731770b
2024-12-18T00:29:23.8741049Z deleted: sha256:b76f4af91cffe2bb7b3f09960f5bdbb26f741419defda65c451c4407fc5b0a92
2024-12-18T00:29:23.8741867Z deleted: sha256:3f8748a00ebd394c0e9d9d481972d764dff58896841ef0150b3f7efaac0f4a4a
2024-12-18T00:29:23.8742654Z deleted: sha256:13989c771e3ba4d40f618344e55e5cb7062a35041b5efd69e2f740ba819f46ee
2024-12-18T00:29:23.8743473Z deleted: sha256:9ebb27837f6c67ad8c17e9af4e63c008faae03fa226c3641dd8bbbfeefb106c4
2024-12-18T00:29:23.8744380Z deleted: sha256:8c16907d735950f8093582bc3cf392b70e002456bf9c4224de5a5b86b78b3ea2
2024-12-18T00:29:23.8745202Z deleted: sha256:6c3e7df31590f02f10cb71fc4eb27653e9b428df2e6e5421a455b062bd2e39f9
2024-12-18T00:29:23.8745679Z 
2024-12-18T00:29:23.8745858Z Total reclaimed space: 37.1GB
2024-12-18T00:29:23.8786214Z ##[group]Run set +e
2024-12-18T00:29:23.8786723Z set +e
2024-12-18T00:29:23.8787074Z set -x
2024-12-18T00:29:23.8787414Z 
2024-12-18T00:29:23.8787734Z nvidia-smi
2024-12-18T00:29:23.8788370Z # NB: Surprisingly, nvidia-smi command returns successfully with return code 0 even in
2024-12-18T00:29:23.8789336Z # the case where the driver has already crashed as it still can get the driver version
2024-12-18T00:29:23.8790272Z # and some basic information like the bus ID.  However, the rest of the information
2024-12-18T00:29:23.8791018Z # would be missing (ERR!), for example:
2024-12-18T00:29:23.8791495Z #
2024-12-18T00:29:23.8791946Z # +-----------------------------------------------------------------------------+
2024-12-18T00:29:23.8792693Z # | NVIDIA-SMI 525.89.02    Driver Version: 525.89.02    CUDA Version: 12.0     |
2024-12-18T00:29:23.8793526Z # |-------------------------------+----------------------+----------------------+
2024-12-18T00:29:23.8794288Z # | GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
2024-12-18T00:29:23.8795105Z # | Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
2024-12-18T00:29:23.8795802Z # |                               |                      |               MIG M. |
2024-12-18T00:29:23.8796338Z # |===============================+======================+======================|
2024-12-18T00:29:23.8797140Z # |   0  ERR!                Off  | 00000000:00:1E.0 Off |                 ERR! |
2024-12-18T00:29:23.8797855Z # |ERR!  ERR! ERR!    ERR! / ERR! |   4184MiB / 23028MiB |    ERR!      Default |
2024-12-18T00:29:23.8798497Z # |                               |                      |                 ERR! |
2024-12-18T00:29:23.8799130Z # +-------------------------------+----------------------+----------------------+
2024-12-18T00:29:23.8799677Z #
2024-12-18T00:29:23.8800130Z # +-----------------------------------------------------------------------------+
2024-12-18T00:29:23.8800906Z # | Processes:                                                                  |
2024-12-18T00:29:23.8801566Z # |  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
2024-12-18T00:29:23.8802166Z # |        ID   ID                                                   Usage      |
2024-12-18T00:29:23.8802741Z # |=============================================================================|
2024-12-18T00:29:23.8803299Z # +-----------------------------------------------------------------------------+
2024-12-18T00:29:23.8803781Z #
2024-12-18T00:29:23.8804285Z # This should be reported as a failure instead as it will guarantee to fail when
2024-12-18T00:29:23.8804941Z # Docker tries to run with --gpus all
2024-12-18T00:29:23.8805378Z #
2024-12-18T00:29:23.8805864Z # So, the correct check here is to query one of the missing piece of info like
2024-12-18T00:29:23.8806528Z # GPU name, so that the command can fail accordingly
2024-12-18T00:29:23.8807141Z nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0
2024-12-18T00:29:23.8807697Z NVIDIA_SMI_STATUS=$?
2024-12-18T00:29:23.8808072Z 
2024-12-18T00:29:23.8808637Z # These are acceptable return code from nvidia-smi as copied from setup-nvidia GitHub action
2024-12-18T00:29:23.8809471Z if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then
2024-12-18T00:29:23.8810214Z   echo "NVIDIA driver installation has failed, shutting down the runner..."
2024-12-18T00:29:23.8810843Z   .github/scripts/stop_runner_service.sh
2024-12-18T00:29:23.8811282Z fi
2024-12-18T00:29:23.8811585Z 
2024-12-18T00:29:23.8812239Z # For runner with multiple GPUs, we also want to confirm that the number of GPUs are the
2024-12-18T00:29:23.8813053Z # power of 2, i.e. 1, 2, 4, or 8. This is to avoid flaky test issue when one GPU fails
2024-12-18T00:29:23.8813726Z # https://github.com/pytorch/test-infra/issues/4000
2024-12-18T00:29:23.8814277Z GPU_COUNT=$(nvidia-smi --list-gpus | wc -l)
2024-12-18T00:29:23.8814753Z NVIDIA_SMI_STATUS=$?
2024-12-18T00:29:23.8815121Z 
2024-12-18T00:29:23.8815695Z # These are acceptable return code from nvidia-smi as copied from setup-nvidia GitHub action
2024-12-18T00:29:23.8816503Z if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then
2024-12-18T00:29:23.8817243Z   echo "NVIDIA driver installation has failed, shutting down the runner..."
2024-12-18T00:29:23.8817875Z   .github/scripts/stop_runner_service.sh
2024-12-18T00:29:23.8818314Z fi
2024-12-18T00:29:23.8818631Z 
2024-12-18T00:29:23.8818985Z # Check the GPU count to be a power of 2
2024-12-18T00:29:23.8819702Z if [ "$GPU_COUNT" -le 8 ] && [ "$GPU_COUNT" -ne 1 ] && [ "$GPU_COUNT" -ne 2 ] && [ "$GPU_COUNT" -ne 4 ] && [ "$GPU_COUNT" -ne 8 ]; then
2024-12-18T00:29:23.8820641Z   echo "NVIDIA driver detects $GPU_COUNT GPUs. The runner has a broken GPU, shutting it down..."
2024-12-18T00:29:23.8821352Z   .github/scripts/stop_runner_service.sh
2024-12-18T00:29:23.8821790Z fi
2024-12-18T00:29:23.8831665Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:29:23.8832167Z env:
2024-12-18T00:29:23.8832476Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:29:23.8832909Z   GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all
2024-12-18T00:29:23.8833620Z   DOCKER_CONTAINER_ID: bc82ba0d076633e811438c4a6571cf8ae19bb53154d689fc74638b016d9b8168
2024-12-18T00:29:23.8834372Z   RUNNER_WORKSPACE: /home/ec2-user/actions-runner/_work/pytorch
2024-12-18T00:29:23.8834895Z ##[endgroup]
2024-12-18T00:29:23.8864969Z + nvidia-smi
2024-12-18T00:29:23.9087478Z Wed Dec 18 00:29:23 2024       
2024-12-18T00:29:23.9088032Z +-----------------------------------------------------------------------------------------+
2024-12-18T00:29:23.9088728Z | NVIDIA-SMI 550.54.15              Driver Version: 550.54.15      CUDA Version: 12.4     |
2024-12-18T00:29:23.9089388Z |-----------------------------------------+------------------------+----------------------+
2024-12-18T00:29:23.9090079Z | GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
2024-12-18T00:29:23.9090839Z | Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
2024-12-18T00:29:23.9091450Z |                                         |                        |               MIG M. |
2024-12-18T00:29:23.9091995Z |=========================================+========================+======================|
2024-12-18T00:29:23.9174373Z |   0  Tesla M60                      On  |   00000000:00:1E.0 Off |                    0 |
2024-12-18T00:29:23.9175025Z | N/A   27C    P8             13W /  150W |       0MiB /   7680MiB |      0%      Default |
2024-12-18T00:29:23.9175577Z |                                         |                        |                  N/A |
2024-12-18T00:29:23.9176140Z +-----------------------------------------+------------------------+----------------------+
2024-12-18T00:29:23.9176699Z                                                                                          
2024-12-18T00:29:23.9177268Z +-----------------------------------------------------------------------------------------+
2024-12-18T00:29:23.9177847Z | Processes:                                                                              |
2024-12-18T00:29:23.9178480Z |  GPU   GI   CI        PID   Type   Process name                              GPU Memory |
2024-12-18T00:29:23.9179342Z |        ID   ID                                                               Usage      |
2024-12-18T00:29:23.9179884Z |=========================================================================================|
2024-12-18T00:29:23.9180475Z |  No running processes found                                                             |
2024-12-18T00:29:23.9181123Z +-----------------------------------------------------------------------------------------+
2024-12-18T00:29:23.9755322Z + nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0
2024-12-18T00:29:23.9939074Z Tesla M60
2024-12-18T00:29:24.0002868Z + NVIDIA_SMI_STATUS=0
2024-12-18T00:29:24.0003244Z + '[' 0 -ne 0 ']'
2024-12-18T00:29:24.0009830Z ++ nvidia-smi --list-gpus
2024-12-18T00:29:24.0010814Z ++ wc -l
2024-12-18T00:29:24.0269874Z + GPU_COUNT=1
2024-12-18T00:29:24.0270466Z + NVIDIA_SMI_STATUS=0
2024-12-18T00:29:24.0270838Z + '[' 0 -ne 0 ']'
2024-12-18T00:29:24.0271160Z + '[' 1 -le 8 ']'
2024-12-18T00:29:24.0271474Z + '[' 1 -ne 1 ']'
2024-12-18T00:29:24.0347470Z Post job cleanup.
2024-12-18T00:29:24.0407616Z Post job cleanup.
2024-12-18T00:29:24.1408918Z [command]/usr/bin/git version
2024-12-18T00:29:24.1456418Z git version 2.40.1
2024-12-18T00:29:24.1525139Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/d286dc7a-afa3-43d5-99e2-30ef54d9d401' before making global git config changes
2024-12-18T00:29:24.1526319Z Adding repository directory to the temporary git global config as a safe directory
2024-12-18T00:29:24.1531385Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch
2024-12-18T00:29:24.1567856Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2024-12-18T00:29:24.1598661Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
2024-12-18T00:29:24.1949977Z Entering 'android/libs/fbjni'
2024-12-18T00:29:24.2015924Z Entering 'third_party/FP16'
2024-12-18T00:29:24.2083042Z Entering 'third_party/FXdiv'
2024-12-18T00:29:24.2148512Z Entering 'third_party/NNPACK'
2024-12-18T00:29:24.2214851Z Entering 'third_party/NVTX'
2024-12-18T00:29:24.2282370Z Entering 'third_party/VulkanMemoryAllocator'
2024-12-18T00:29:24.2346989Z Entering 'third_party/XNNPACK'
2024-12-18T00:29:24.2430481Z Entering 'third_party/benchmark'
2024-12-18T00:29:24.2495831Z Entering 'third_party/composable_kernel'
2024-12-18T00:29:24.2569817Z Entering 'third_party/cpp-httplib'
2024-12-18T00:29:24.2635126Z Entering 'third_party/cpuinfo'
2024-12-18T00:29:24.2702631Z Entering 'third_party/cudnn_frontend'
2024-12-18T00:29:24.2768524Z Entering 'third_party/cutlass'
2024-12-18T00:29:24.2842160Z Entering 'third_party/eigen'
2024-12-18T00:29:24.2909979Z Entering 'third_party/fbgemm'
2024-12-18T00:29:24.2974595Z Entering 'third_party/fbgemm/third_party/asmjit'
2024-12-18T00:29:24.3038888Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2024-12-18T00:29:24.3103287Z Entering 'third_party/fbgemm/third_party/cutlass'
2024-12-18T00:29:24.3175627Z Entering 'third_party/fbgemm/third_party/googletest'
2024-12-18T00:29:24.3239350Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2024-12-18T00:29:24.3305599Z Entering 'third_party/flatbuffers'
2024-12-18T00:29:24.3372869Z Entering 'third_party/fmt'
2024-12-18T00:29:24.3437776Z Entering 'third_party/gemmlowp/gemmlowp'
2024-12-18T00:29:24.3503107Z Entering 'third_party/gloo'
2024-12-18T00:29:24.3567922Z Entering 'third_party/googletest'
2024-12-18T00:29:24.3633161Z Entering 'third_party/ideep'
2024-12-18T00:29:24.3696638Z Entering 'third_party/ideep/mkl-dnn'
2024-12-18T00:29:24.3768986Z Entering 'third_party/ittapi'
2024-12-18T00:29:24.3833103Z Entering 'third_party/kineto'
2024-12-18T00:29:24.3898335Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2024-12-18T00:29:24.3963868Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-12-18T00:29:24.4030924Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-12-18T00:29:24.4096659Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-12-18T00:29:24.4162924Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-12-18T00:29:24.4227641Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-12-18T00:29:24.4296521Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-12-18T00:29:24.4362847Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-12-18T00:29:24.4428922Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-12-18T00:29:24.4496604Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-12-18T00:29:24.4563876Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2024-12-18T00:29:24.4627373Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2024-12-18T00:29:24.4693696Z Entering 'third_party/mimalloc'
2024-12-18T00:29:24.4758711Z Entering 'third_party/nccl/nccl'
2024-12-18T00:29:24.4823086Z Entering 'third_party/nlohmann'
2024-12-18T00:29:24.4889740Z Entering 'third_party/onnx'
2024-12-18T00:29:24.4975246Z Entering 'third_party/onnx/third_party/pybind11'
2024-12-18T00:29:24.5043018Z Entering 'third_party/opentelemetry-cpp'
2024-12-18T00:29:24.5109797Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-12-18T00:29:24.5174391Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2024-12-18T00:29:24.5238266Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-12-18T00:29:24.5303539Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-12-18T00:29:24.5370505Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-12-18T00:29:24.5434386Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-12-18T00:29:24.5498298Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-12-18T00:29:24.5562022Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-12-18T00:29:24.5627901Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-12-18T00:29:24.5694674Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-12-18T00:29:24.5782365Z Entering 'third_party/pocketfft'
2024-12-18T00:29:24.5846103Z Entering 'third_party/protobuf'
2024-12-18T00:29:24.5914602Z Entering 'third_party/protobuf/third_party/benchmark'
2024-12-18T00:29:24.5978784Z Entering 'third_party/protobuf/third_party/googletest'
2024-12-18T00:29:24.6045508Z Entering 'third_party/psimd'
2024-12-18T00:29:24.6110017Z Entering 'third_party/pthreadpool'
2024-12-18T00:29:24.6174767Z Entering 'third_party/pybind11'
2024-12-18T00:29:24.6238631Z Entering 'third_party/python-peachpy'
2024-12-18T00:29:24.6303842Z Entering 'third_party/sleef'
2024-12-18T00:29:24.6368943Z Entering 'third_party/tensorpipe'
2024-12-18T00:29:24.6437022Z Entering 'third_party/tensorpipe/third_party/googletest'
2024-12-18T00:29:24.6501738Z Entering 'third_party/tensorpipe/third_party/libnop'
2024-12-18T00:29:24.6567718Z Entering 'third_party/tensorpipe/third_party/libuv'
2024-12-18T00:29:24.6631552Z Entering 'third_party/tensorpipe/third_party/pybind11'
2024-12-18T00:29:24.6694734Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-12-18T00:29:24.6783029Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2024-12-18T00:29:24.6803718Z http.https://github.com/.extraheader
2024-12-18T00:29:24.6815466Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader
2024-12-18T00:29:24.6848236Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
2024-12-18T00:29:24.7186476Z Entering 'android/libs/fbjni'
2024-12-18T00:29:24.7229272Z http.https://github.com/.extraheader
2024-12-18T00:29:24.7270342Z Entering 'third_party/FP16'
2024-12-18T00:29:24.7313333Z http.https://github.com/.extraheader
2024-12-18T00:29:24.7352513Z Entering 'third_party/FXdiv'
2024-12-18T00:29:24.7397275Z http.https://github.com/.extraheader
2024-12-18T00:29:24.7435868Z Entering 'third_party/NNPACK'
2024-12-18T00:29:24.7481089Z http.https://github.com/.extraheader
2024-12-18T00:29:24.7519860Z Entering 'third_party/NVTX'
2024-12-18T00:29:24.7565483Z http.https://github.com/.extraheader
2024-12-18T00:29:24.7605486Z Entering 'third_party/VulkanMemoryAllocator'
2024-12-18T00:29:24.7649060Z http.https://github.com/.extraheader
2024-12-18T00:29:24.7689402Z Entering 'third_party/XNNPACK'
2024-12-18T00:29:24.7733378Z http.https://github.com/.extraheader
2024-12-18T00:29:24.7791064Z Entering 'third_party/benchmark'
2024-12-18T00:29:24.7834453Z http.https://github.com/.extraheader
2024-12-18T00:29:24.7874552Z Entering 'third_party/composable_kernel'
2024-12-18T00:29:24.7918346Z http.https://github.com/.extraheader
2024-12-18T00:29:24.7967822Z Entering 'third_party/cpp-httplib'
2024-12-18T00:29:24.8011085Z http.https://github.com/.extraheader
2024-12-18T00:29:24.8052474Z Entering 'third_party/cpuinfo'
2024-12-18T00:29:24.8097748Z http.https://github.com/.extraheader
2024-12-18T00:29:24.8137586Z Entering 'third_party/cudnn_frontend'
2024-12-18T00:29:24.8181817Z http.https://github.com/.extraheader
2024-12-18T00:29:24.8221814Z Entering 'third_party/cutlass'
2024-12-18T00:29:24.8266757Z http.https://github.com/.extraheader
2024-12-18T00:29:24.8313727Z Entering 'third_party/eigen'
2024-12-18T00:29:24.8359940Z http.https://github.com/.extraheader
2024-12-18T00:29:24.8402492Z Entering 'third_party/fbgemm'
2024-12-18T00:29:24.8446989Z http.https://github.com/.extraheader
2024-12-18T00:29:24.8488127Z Entering 'third_party/fbgemm/third_party/asmjit'
2024-12-18T00:29:24.8531105Z http.https://github.com/.extraheader
2024-12-18T00:29:24.8570844Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2024-12-18T00:29:24.8613207Z http.https://github.com/.extraheader
2024-12-18T00:29:24.8652870Z Entering 'third_party/fbgemm/third_party/cutlass'
2024-12-18T00:29:24.8696002Z http.https://github.com/.extraheader
2024-12-18T00:29:24.8743070Z Entering 'third_party/fbgemm/third_party/googletest'
2024-12-18T00:29:24.8786751Z http.https://github.com/.extraheader
2024-12-18T00:29:24.8825946Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2024-12-18T00:29:24.8869948Z http.https://github.com/.extraheader
2024-12-18T00:29:24.8910140Z Entering 'third_party/flatbuffers'
2024-12-18T00:29:24.8954103Z http.https://github.com/.extraheader
2024-12-18T00:29:24.8996220Z Entering 'third_party/fmt'
2024-12-18T00:29:24.9040015Z http.https://github.com/.extraheader
2024-12-18T00:29:24.9079699Z Entering 'third_party/gemmlowp/gemmlowp'
2024-12-18T00:29:24.9124291Z http.https://github.com/.extraheader
2024-12-18T00:29:24.9165258Z Entering 'third_party/gloo'
2024-12-18T00:29:24.9208329Z http.https://github.com/.extraheader
2024-12-18T00:29:24.9247466Z Entering 'third_party/googletest'
2024-12-18T00:29:24.9292296Z http.https://github.com/.extraheader
2024-12-18T00:29:24.9331884Z Entering 'third_party/ideep'
2024-12-18T00:29:24.9375787Z http.https://github.com/.extraheader
2024-12-18T00:29:24.9413715Z Entering 'third_party/ideep/mkl-dnn'
2024-12-18T00:29:24.9458399Z http.https://github.com/.extraheader
2024-12-18T00:29:24.9505563Z Entering 'third_party/ittapi'
2024-12-18T00:29:24.9549717Z http.https://github.com/.extraheader
2024-12-18T00:29:24.9589041Z Entering 'third_party/kineto'
2024-12-18T00:29:24.9632653Z http.https://github.com/.extraheader
2024-12-18T00:29:24.9672703Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2024-12-18T00:29:24.9715020Z http.https://github.com/.extraheader
2024-12-18T00:29:24.9754676Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-12-18T00:29:24.9798038Z http.https://github.com/.extraheader
2024-12-18T00:29:24.9839748Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-12-18T00:29:24.9883995Z http.https://github.com/.extraheader
2024-12-18T00:29:24.9923764Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-12-18T00:29:24.9968887Z http.https://github.com/.extraheader
2024-12-18T00:29:25.0010435Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-12-18T00:29:25.0055085Z http.https://github.com/.extraheader
2024-12-18T00:29:25.0095206Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-12-18T00:29:25.0138417Z http.https://github.com/.extraheader
2024-12-18T00:29:25.0181936Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-12-18T00:29:25.0225475Z http.https://github.com/.extraheader
2024-12-18T00:29:25.0266907Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-12-18T00:29:25.0309163Z http.https://github.com/.extraheader
2024-12-18T00:29:25.0350594Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-12-18T00:29:25.0394333Z http.https://github.com/.extraheader
2024-12-18T00:29:25.0435117Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-12-18T00:29:25.0479252Z http.https://github.com/.extraheader
2024-12-18T00:29:25.0520639Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2024-12-18T00:29:25.0564209Z http.https://github.com/.extraheader
2024-12-18T00:29:25.0603197Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2024-12-18T00:29:25.0646953Z http.https://github.com/.extraheader
2024-12-18T00:29:25.0690510Z Entering 'third_party/mimalloc'
2024-12-18T00:29:25.0733265Z http.https://github.com/.extraheader
2024-12-18T00:29:25.0773522Z Entering 'third_party/nccl/nccl'
2024-12-18T00:29:25.0816866Z http.https://github.com/.extraheader
2024-12-18T00:29:25.0855496Z Entering 'third_party/nlohmann'
2024-12-18T00:29:25.0900192Z http.https://github.com/.extraheader
2024-12-18T00:29:25.0939994Z Entering 'third_party/onnx'
2024-12-18T00:29:25.0983472Z http.https://github.com/.extraheader
2024-12-18T00:29:25.1040483Z Entering 'third_party/onnx/third_party/pybind11'
2024-12-18T00:29:25.1084795Z http.https://github.com/.extraheader
2024-12-18T00:29:25.1126215Z Entering 'third_party/opentelemetry-cpp'
2024-12-18T00:29:25.1172577Z http.https://github.com/.extraheader
2024-12-18T00:29:25.1214218Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-12-18T00:29:25.1257511Z http.https://github.com/.extraheader
2024-12-18T00:29:25.1297762Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2024-12-18T00:29:25.1340398Z http.https://github.com/.extraheader
2024-12-18T00:29:25.1380720Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-12-18T00:29:25.1423112Z http.https://github.com/.extraheader
2024-12-18T00:29:25.1463525Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-12-18T00:29:25.1506900Z http.https://github.com/.extraheader
2024-12-18T00:29:25.1547269Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-12-18T00:29:25.1591331Z http.https://github.com/.extraheader
2024-12-18T00:29:25.1630301Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-12-18T00:29:25.1675699Z http.https://github.com/.extraheader
2024-12-18T00:29:25.1714860Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-12-18T00:29:25.1758617Z http.https://github.com/.extraheader
2024-12-18T00:29:25.1797030Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-12-18T00:29:25.1841042Z http.https://github.com/.extraheader
2024-12-18T00:29:25.1883892Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-12-18T00:29:25.1927052Z http.https://github.com/.extraheader
2024-12-18T00:29:25.1969476Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-12-18T00:29:25.2012410Z http.https://github.com/.extraheader
2024-12-18T00:29:25.2076620Z Entering 'third_party/pocketfft'
2024-12-18T00:29:25.2120774Z http.https://github.com/.extraheader
2024-12-18T00:29:25.2160684Z Entering 'third_party/protobuf'
2024-12-18T00:29:25.2205604Z http.https://github.com/.extraheader
2024-12-18T00:29:25.2248376Z Entering 'third_party/protobuf/third_party/benchmark'
2024-12-18T00:29:25.2292390Z http.https://github.com/.extraheader
2024-12-18T00:29:25.2330907Z Entering 'third_party/protobuf/third_party/googletest'
2024-12-18T00:29:25.2375726Z http.https://github.com/.extraheader
2024-12-18T00:29:25.2417315Z Entering 'third_party/psimd'
2024-12-18T00:29:25.2462055Z http.https://github.com/.extraheader
2024-12-18T00:29:25.2501784Z Entering 'third_party/pthreadpool'
2024-12-18T00:29:25.2546627Z http.https://github.com/.extraheader
2024-12-18T00:29:25.2586565Z Entering 'third_party/pybind11'
2024-12-18T00:29:25.2630662Z http.https://github.com/.extraheader
2024-12-18T00:29:25.2671625Z Entering 'third_party/python-peachpy'
2024-12-18T00:29:25.2716247Z http.https://github.com/.extraheader
2024-12-18T00:29:25.2754487Z Entering 'third_party/sleef'
2024-12-18T00:29:25.2800115Z http.https://github.com/.extraheader
2024-12-18T00:29:25.2839338Z Entering 'third_party/tensorpipe'
2024-12-18T00:29:25.2884065Z http.https://github.com/.extraheader
2024-12-18T00:29:25.2923800Z Entering 'third_party/tensorpipe/third_party/googletest'
2024-12-18T00:29:25.2968064Z http.https://github.com/.extraheader
2024-12-18T00:29:25.3007191Z Entering 'third_party/tensorpipe/third_party/libnop'
2024-12-18T00:29:25.3050450Z http.https://github.com/.extraheader
2024-12-18T00:29:25.3090613Z Entering 'third_party/tensorpipe/third_party/libuv'
2024-12-18T00:29:25.3132987Z http.https://github.com/.extraheader
2024-12-18T00:29:25.3173865Z Entering 'third_party/tensorpipe/third_party/pybind11'
2024-12-18T00:29:25.3216954Z http.https://github.com/.extraheader
2024-12-18T00:29:25.3255346Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-12-18T00:29:25.3299155Z http.https://github.com/.extraheader
2024-12-18T00:29:25.3443801Z A job completed hook has been configured by the self-hosted runner administrator
2024-12-18T00:29:25.3473202Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh'
2024-12-18T00:29:25.3479710Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:29:25.3480263Z ##[endgroup]
2024-12-18T00:29:25.3574923Z [!ALERT!] Swap in detected! [!ALERT!]
2024-12-18T00:29:40.3327078Z [!ALERT!] Swap out detected [!ALERT!]
2024-12-18T00:30:03.6357669Z Cleaning up orphan processes